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(54) Television broadcasting system with storage in consumer platforms 

(57) The present invention alms to provide a broad- 
casting system based on storage (204,212) in con- p|Q 
sumer platfonns wherein a broadcasting station side 
(100) controls the playback and viewing of images and 
voice stored in a receiving side (200) so to make it pos- 
sible to perform the broadcasting service in various 
forms, and the broadcast transmitting apparatus (100) 
of the invention multiplexes (103) AV data and provision 
information for designating AV data, which the informa- 
tion provider intends to replay and view in accordance 
with the display of the AV data, and transmits It Then, a 
broadcast reviving apparatus (200) makes it possible 
to replay and view only the AV designated by provision 
infonnation corresponding to the AV data presented by 
a presentation information selecting means when out- 
putting the received AV data and displaying it. The infor- 
mation provider transmits infonnation, whfch the 
information provKier of the broadcasting station side 
has created intentionally, when the information provider 
intends, and a viewer can receive infonnation as the 
infonnation provider intends, and view a portion or the 
entirety of the program broadcast so far based on the 
informatfon. 
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Description 

[0001] The present invention relates to a broadcast- 
ing system based on storage in consumer platforms, 
wherein a broadcasting station side transmits a pro- 
gram and information of the program, a receiving appa- 
ratus stores them to present them to a viewer in various 
kinds of service forms, and relates to the transmitting 
apparatus and the receiving apparatus, and particularly 
characterized in that the viewer can view stored images 
and voice associated with the scene of the program by 
the broadcasting station as viewing the program. 
[0002] In the digital broadcasting, there has been 
conventionally made the study and development of the 
a broadcasting system based on storage in consumer 
platforms wherein a storage medium is placed in a 
receiving apparatus such as a television and the con- 
tent of a program and information accompanying there- 
with are stored, and displayed in various l<inds of 
service forms. 

[0003] Japanese Patent Laid-Open No. 9-135391 
discloses a broadcasting system wherein a transmitting 
side transmits section infonnation that designates a 
highlight portion, the receiving apparatus stores only 
the portion, and the viewer of the receiving side can 
replay and view the stored highlight scene and view it 
whenever necessary. 

[0004] Japanese Patent Laid-Open No. 10-304321 
discloses a broadcasting system wherein the transmit- 
ting side transmits additional infonnation of a program 
and the receiving side stores the additional infonnation 
[0005] However, In the conventional a broadcasting 
system based on storage in consumer platfbmis, since 
the selection from the stored highlight scenes and addi- 
tional information depends on the viewers, it is difficult 
for the viewers to search for information that ttiey wish in 
a case where a large amount of information is stored. 
[0006] IVIoreover, though the highlight scene can 
change with a lapse of time in such a live broadcasting 
program, the conventional system cannot appropriately 
correspond to the change in the highlight scene since 
once the scene is designated as a highlight, the scene 
will be stored in the receiving apparatus. 
[0007] The cause of such a problem is that the play- 
back and viewing of the images and voice stored by the 
receiving side cannot be controlled by the broadcasting 
station side in the conventional a broadcasting system 
based on storage in consumer platforms. 
[0008] If the playback and viewing of the images 
and voice stored by the receiving side can be controlled 
by the broadcasting station side, which will serve such a 
viewing forni that ttie viewer can playback and view the 
image relating to the broadcasting scene, which the 
broadcasting station (information provider) designates 
from the images stored, as the viewer viewing the cur- 
rently broadcasting program. For example, in the case 
of the broadcast of a baseball game, the information 
provider exercises control such that only tiie images of 



past scenes relating to a batter at bat, who is now in the 
batter's box, can be replayed and viewed. Then, the 
viewer selects the playback and viewing as viewing the 
live broadcast of baseball game so that conditions of the 
5 batter's at bat so far can be seen from the repl^d 
image. 

[0009] Moreover, if the viewer views the program 
from halfway, it is possible to replay the scenes, which 
designated by the broadcasting station from the images 

10 stored, and to see a rough outline of the program. 
[0010] In consideration of the above-mentioned 
points, the present invention is one tiiat improves the 
conventional system, and it is an aim of the present 
invention to provide a a broadcasting system based on 

15 storage in consumer platfbmis wherein a broadcasting 
side controls the playback and viewing of images and 
voice stored by the receiving side so as to make it pos- 
sible to provide the broadcast services in various fomns, 
and to provide a broadcast transmitting apparatus and a 

20 broadcast receiving apparatus of the system. 

[0011] According to the present invention, in the a 
broadcasting system based on storage in consumer 
platfomis comprising a broadcast ti^nsmitting appara- 
tus Ibr transmitting AV data composed of an image of a 

25 program and vok;e and a broadcast receiving apparatus 
having storing means for storing received signals, 
wherein the broadcast transmitting apparatus multi- 
plexes AV data and provision information designates AV 
data, intending to permit an information provider to 

30 replay and view In accordance with the display of the AV 
data, and transmits it, and the broadcast receiving 
apparatus makes it possible to replay and view only the 
AV data designated by the provision infonnation corre- 
sponding to the AV data when displaying the received 

35 AVdata. 

[0012] Whereby, information, which Is created by 
tlie information provider of the broadcast transmitting 
apparatus side intentionally, is transmitted when the 
infonnation provider intends, and the user of the broad- 
40 cast receiving apparatus side can receive infonnation 
as the information provider of the broadcast transmitting 
apparatus side Intended, and can view a portion or the 
entirety of the program broadcast so far based on the 
information. 

45 [0013] Moreover, the broadcast transmitting appa- 
ratus comprises AV material storing means for storing 
AV data, AV material selecting means for selecting AV 
data from the AV material storing means, provision 
information storing means for storing the provision infor- 

50 mation, provision infonnation selecting means for 
selecting provision information from the provision infor- 
mation storing means, multiplexing means for multiplex- 
ing the AV data selected by the AV material selecting 
means and the provision information selected by the 

55 provision information selecting means to generate a 
multiplexed signal, and transmitting means for convert- 
ing the multiplexed signal to a broadcast signal in 
accordance with a transmission rule and transmitting it. 
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[0014] Whereby, provision information linl<ecl to AV 
data, which the intonnation provider of the broadcast 
transmitting apparatus has intentionally edited, can be 
provided as information relating to AV data, which Is 
cun-ently broadcasting, and the broadcast transmitting 
apparatus can control information to be provided 
according to the content of the program, which is cur- 
rently broadcasting. 

[0015] Moreover, the broadcast receiving appara- 
tus comprises receiving means for receiving a broad- 
cast signal, separating means for separating data 
received by the receiving means into AV data and the 
provision information, AV data storage processing 
means for performing storage processing of the sepa- 
rated AV data, AV data storing means for storing AV 
data subjected to storage processing by the AV data 
storage processing means, AV data selecting means for 
selecting necessary AV data from the AV data storing 
means, AV data output controlling means for determin- 
ing AV data to be externally output among AV data from 
the separating means and AV data from the AV data 
selecting means, presentation information storage 
processing means for converting the provision informa- 
tion separated by the separating means to the presenta- 
tion infonnation, presentation information storing means 
for storing the presentation information, presentation 
information selecting means for selecting the presenta- 
tion information stored in the presentation information 
storing means to provide an instruction of selecting AV 
data to the AV data selecting means based on the 
selected presentation information, and presentation 
information externally outputting means for externally 
outputting the presentation information from the presen- 
tation information selecting means. 
[0016] Whereby, presentation infonnation linked to 
AV data can be presented simultaneously with AV data 
separated at the same time, and the user arbitrarily 
selects the presentation elements of the presentation 
information, so that a portion or the entirety of stored AV 
data linked to the presentation element can be replayed, 
and the user can view stored AV data corresponding to 
the selected presentation element. 
[0017] According to the invention described in claim 
1, the present invention comprises the a broadcasting 
system based on storage in consumer platforms com- 
prising a broadcast transmitting apparatus for transmit- 
ting AV data composed of an image of a program and 
voice and a broadcast receiving apparatus having stor- 
ing means for storing received signals, wherein broad- 
cast transmitting apparatus multiplexes AV data and 
provision information which designates AV data intend- 
ing an information provider to replay and view in accord- 
ance with the display of the AV data, and transmits it, 
and the broadcast receiving apparatus makes it possi- 
ble to replay and view only the AV designated by the 
provision information corresponding to the AV data 
when displaying the received AV data. Whereby, infor- 
mation, which the infbmiation provider of the broadcast 



transmitting apparatus side has intentionally created, is 
transmitted when the information provider intends, and 
the user of the broadcast transmitting apparatus side 
can receive information as the information provider of 

5 the broadcast transmitting apparatus side intended, and 
can view a portion or the entirety of the program broad- 
cast so far based on the infonrtation. 
[0018] The invention described in claim 2 is that the 
broadcast receiving apparatus generates and stores 

10 presentation information, which enables the uses to 
choose the playback and viewing of the AV data stored 
to correspond to the provision information. The broad- 
cast receiving apparatus creates presentation informa- 
tion wherein provision information is associated with AV 

15 data multiplexed at this time, and stores it, whereby per- 
fonnlng the program viewing as the information provider 
intended even if the AV data Is replayed after the broad- 
casting. 

[0019] The invention described in claim 3 com- 
20 prises an AV data providing apparatus for storing all AV 
data transmitted from the broadcast transmitting appa- 
ratus wherein the broadcast receiving apparatus 
obtains the AV data from the AV data providing appara- 
tus when there is no AV data that a user wishes to 
25 replay and view in the storing means of the broadcast 
receiving apparatus. Whereby, even if the broadcast 
receiving apparatus dose not store the entirely of the 
programs so far or can not store them, AV data broad- 
cast so far can be replayed without fail when it is 
30 intended to be replayed since there Is provided the AV 
data providing apparatus, which manages a portion or 
the entirety of AV data and which transmits it as 
required. 

[0020] The invention described in claim 4 is the 

35 broadcast transmitting apparatus constituting the a 
broadcasting system based on storage in consumer 
platforms according to claim 1, 2, or 3, wherein the 
broadcast transmitting apparatus comprises AV mate- 
rial storing means for storing AV data, AV material 

40 selecting means for selecting AV data from the AV 
material storing means, provision information storing 
means for storing the provision infonnation, provision 
information selecting means for selecting provision 
infonnation from the provision infbrmatnn storing 

45 means, multiplexing means for muKiplexing the AV data 
selected by the AV material selecting means and the 
provision information selected by the provision informa- 
tion selecting means to generate a multiplexed signal, 
and transmitting means for converting the multiplexed 

50 signal to a broadcast signal in accordance with a trans- 
mission rule so as to transmit it. Whereby, it is possible 
to provide provision information as information relating 
to AV data cun-ently broadcasting, whtoh changes with 
providing time and is linked to AV data, the AV data 

55 being edited by the information provider of the broad- 
cast transmitting apparatus side intentionally, and Infor- 
mation to be provided can be controlled according to the 
content of the program, which is currently broadcasting. 
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by the broadcast transmitting apparatus. 

[0021 ] According to the invention described in claim 

5, the provision information is composed of provision 
elements systemized in the form of a hierarchical struc- 
ture, and the provision information selecting means 
selects a portion or the entirety of the provision ele- 
ments, so that the selection of presentation information 
can be efficiently performed. 

[0022] According to the invention described in claim 

6, the provision information is linked to the AV data des- 
ignated by the provision infonnation, and the informa- 
tion provider of the broadcast transmitting apparatus 
side provides provision infonnation linked to AV data as 
information to be provided simultaneously with AV data, 
which is cun-ently broadcasting. 

[0023] According to the invention described in claim 

7, information of the linked AV data is described in the 
provision element, and that each provision element can 
be linked to AV data. 

[0024] According to the invention described in claim 

8, the linked AV data is updated with a lapse of time, and 
that the information provider can change AV data, which 
has been intentionally edited, by providing time. 
[0025] According to the invention described in claim 

9, the provision infonnation includes enabling Infonna- 
tion for making a portion or the entirety of presentation 
information available, which has been stored in the 
broadcast receiving apparatus and which has been 
linked to AV data. Whereby, a portion or the entirety of 
the provision information is transmitted from the broad- 
cast transmitting apparatus in advance. Then, at the 
time of providing infonnation relating to the content of 
the program, which is currently broadcasting, only the 
enabling information for searching and extracting the 
elements of the provision infonnation that is made effec- 
tive from the provision information linked to AV data 
broadcast so far may be transmitted. This reduces the 
number of operator's operations for providing Infonna- 
tion. 

[0026] According to the invention described in claim 

1 0, a playback and viewing range of the AV data, which 
the information provider intends, is specified by cutting 
information, and the provision information is linked to 
the cuffing infonnation. Whereby, the broadcast trans- 
mitting apparatus can carry out work for culling AV data 
and work for selecting provision information separately, 
so that the work of information provider can be shared 
and information can be provided efficiently. 

[0027] According to the invention described in claim 

11, a presenting method of the stored presentation 
infonnation in the broadcast receiving apparatus is des- 
ignated in the provision information. Whereby, AV data 
and presentation information once stored can be pro- 
vided at timing other than provide timing when the infor- 
mation provider has transmitted them in real time. 
IVloreover, since the program is stored, the user can 
fraely view previous infonnation of the program by the 
stored presentafion infonnation. 
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[0028] The invention described in claim 12 is the 
broadcast receiving apparatus constituting the a broad- 
casting system based on storage in consumer platfonns 
according to claim 1, 2, or 3, the broadcast receiving 

5 apparatus comprises receiving means for receiving a 
broadcast signal, separating means for separating data 
received by the receiving means into AV data and the 
provision information, AV data storage processing 
means for performing storage processing of the AV 

10 data, AV data storing means for storing AV data sub- 
jected to storage processing by the AV data storage 
processing means, AV data selecting means for select- 
ing necessary AV data from the AV data storing means, 
AV data output controlling means for detemiining AV 

IS data to be externally output by AV data from the sepa- 
rating means and AV data from the AV data selecting 
means, presentation infonnation storage processing 
means for converting the provision infomriaiion sepa- 
rated by the separating means to the presentation infor- 

20 mation, presentation information storing means for 
storing the presentation information, presentation infor- 
mation selecting means for selecting the presentation 
infomiatfon stored in the presentation information stor- 
ing means to provide an instruction of selecting AV data 

25 to the AV data selecting means based on the selected 
presentation information, and presentation information 
externally outputting means for externally outputting the 
presentation infonnation from the presentation infonna- 
tion selecting means. Whereby, it is possible to present 

30 the presentation infonnation linked to AV data simulta- 
neously with AV data separated at the same time, and 
the user arbitrarily selects the element of the presenta- 
tion information. Since this allows the user to view a por- 
tion or the entirety of stored AV data linked to the 

35 element, the user can view the stored AV data corre- 
sponding to the selected presentation element. 
[0029] According to the invention described in claim 

13, AV data received in real time is separated by the 
separating means to be output to an external device, 

40 and the AV data is stored in the AV data storing means, 
and the presentation infonnation to be externally output 
is generated based on the provision information 
received in real time, and when anyl presentation infor- 
mation is selected therefrom, the corresponding data of 

45 the stored AV data is replayed. Since the program can 
be stored whenever necessary as outputting the pro- 
gram, which is on the air, it is possible to catch up with 
the program, which is on the air, by performing playback 
in fast fonward even while AV data broadcast so far in 

50 the program, which is on the air, is reproducing, and it is 
possible to view the program even after the broadcast is 
ended. 

[0030] According to the invention described in claim 

14, when the presentation information storing means 
55 stores the presentation information in advance and ena- 
bling information is transmitted from the broadcast 
transmitting apparatus, the presentation information 
selecting means selects presentation information, 
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which has been made available by the enabling infomia- 
tion, from the presentation informalion stored in the 
presentation infbmiation storing means. The user can 
obtain only the provision Infonnatlon, which is made 
effective by the Information provider at this time, from a 5 
large amount of presentation InfonnaUon stored, and It 
is possible to view a portion or the entirety of AV data 
stored so fer based on the infomiation. 
[0031 ] According to the invention described in claim 
1 4, the presentation information storing means stores 10 
cuffing information that specifies a playback and view- 
ing range of AV data transmitted from the broadcast 
transmitting apparatus, and the presentation informa- 
tion selecting means provides the instruction of select- 
ing AV data to the AV data selecting means by use of 15 
the preserrtation information and the cuffing information. 
Because clarify the relationship between the presenta- 
tion information and the cutting information is clarified, 
the user can easily carry out edition agreeable to the 
user's taste. Moreover, the user can obtain intended so 
information when the infonnation provider intends. 
[0032] According to the invention described In claim 
16, the way of selection of presentation infonnation by 
the presentation information selecting means is limited 
based on a rule set by a user or an output history of AV zs 
data output from the AV data output controlling means. 
Whereby, provision information sent from the broadcast 
transmitting apparatus Is converted to presentation 
information in the broadcast receiving apparatus, and 
the broadcast receiving apparatus can designate ena- 30 
bling information that makes only the limited presenta- 
tion information effective. This makes it possible to 
reflect the information provider's intentton in the infor- 
mation and to present enabling Infonnation tor the user. 
Moreover, even if presentation information is stored in as 
the broadcast receiving apparatus, the information pro- 
vider of the broadcast transmitting apparatus transmits 
enabling infonnation for extracting information to be cur- 
rently provided, whereby narrowing the present range of 
presentation Information. Furthermore, the user of the to 
broadcast receiving apparatus can fix enabling Infonna- 
tion that makes only the limited presentation information 
effective. This makes it possible to reflect the informa- 
tion provider's intention in the infonnation and also to 
present enabling infonnation for the user. 4S 
[0033] The above structure and features of the 
present invention will be apparent from the following 
detailed description taken in conjunction with the 
accompanying drawings in which : 

50 

Fig. 1 is a schematic block diagram of a broadcast 

system (broadcast transmitting apparatus and 

broadcast receiving apparatus) according to a first 

embodiment of the present invention; 

Fig. 2 is a view explaining provision information and 55 

AV data according to the broadcast transmitting 

apparatus of the first embodiment; 

Fig. 3 is a view explaining the description of provid- 



ing timing of provision information according to the 
broadcast transmitting apparatus of the first 
embodiment. 

Fig. 4 is a view explaining transmission timing of 
provision infonnation with ON/OFF according to the 
broadcast transmitting apparatus of the first 
embodiment, 

Fig. 5 Is a view explaining transmisaon timing of 
provision information with effective time according 
to the broadcast transmitting apparatus of the first 
embodiment, 

Rg. 6 is a view explaining presentation information 
and AV data according to the broadcast transmit- 
ting apparatus of the first embodiment, 
Fig. 7 Is an example of presentation information 
according to the broadcast transmitting apparatus 
of the first embodiment, 

Rg. 8 is a flowchart of transmission according to 
the broadcast transmitting apparatus of the first 
embodiment, 

Rg. 9 is a flowchart of provision Information selec- 
tion processing according to the broadcast trans- 
mitting apparatus of the first embodiment, 
Rg. 10 is a flowchart of presentation according to 
the broadcast transmitting apparatus of the first 
embodiment, 

Rg. 1 1 is a view explaining a provision Information 
transmission unit according to the broadcast trans- 
mitting apparatus of the first embodiment, 
Rg. 12 is a flowchart of provision information selec- 
tion processing according to the broadcast trans- 
mitting apparatus of a second embodiment, 
Rg. 1 3 is an example of provision Infonnation when 
there is enabling information according to the 
broadcast transmitting apparatus of the second 
embodiment, 

Rg. 14 Is an example of enabling information 
according to the broadcast transmitting apparatus 
of the second embodiment, 
Rg. 15 is an example of enabling Information 
according to the broadcast receiving apparatus of 
the second embodiment, 

Rg. 1 6 is an example of cuffing information accord- 
ing to the broadcast transmitting apparatus of a 
third embodftnent, 

Rg. 17 is an example of cutting information accord- 
ing to the broadcast transmitting apparatus of the 
third embodiment, 

Rg. 18 is an example of provision infonnation (play- 
back control after storage) according to the broad- 
cast transmitting apparatus of a fourth embodiment, 
Rg. 19 is a configuration of the broadcasting sys- 
tem having an AV data providing apparatus accord- 
ing to a sixth embodiment, 
Rg. 20 is a flowchart of AV data playback by the 
broadcast receiving apparatus having the AV data 
providing apparatus according to the sixth embodi- 
ment, and 
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Fig. 21 is a flowchart of AV data transmission of the 
AV data providing apparatus according to the sixth 
embodiment. 

[0034] The following will explain embodiments of 
the present Invention with reference to Figs. 1 to 21. 

(First embodiment) 

[0035] A broadcasting system according to the first 
embodiment, as shown in Fig.1 , comprises a broadcast 
transmitting apparatus 100 and a broadcast receiving 
apparatus 200, and the broadcast transmitting appara- 
tus 100 Includes an AV material storing means 101 that 
stores data such as an image, a voice and the like 
(hereinafter refen-ed to as AV data), an AV material 
selecting means 1 02 for selecting necessary AV materi- 
als from the AV material storing means 101, a provision 
information storing means 1 1 1 that stores information 
linked to the AV materials (hereinafter referred to as pro- 
vision infonnation), an provision Information selecting 
means 112 for selecting necessary provision infonna- 
tion from the provision Information storing means 1 11 , a 
multiplexing means 103 for multiplexing AV data 
selected by the AV material selecting means 102 and 
provision information selected by the provision Infonna- 
tion selecting means 1 1 2, and a transmitfing means 1 04 
for converting a multiplexed signal obtained by the mul- 
tiplexing means 103 to a transmission format to be 
transmitted. 

[0036] Also, the broadcast receiving apparatus 
Includes a receiving means 201 for receiving broadcast- 
ing data in which AV data and provide data are multi- 
plexed, a separating means 202 for separating 
broadcasting data received by the receiving means 201 
into AV data and provision information linked to AV data, 
an AV data storage processing means 203 that per- 
forms storage processing of the separated AV data, an 
AV data storing means 204 for storing AV data sub- 
jected to storage processing by the AV data storage 
processing means 203, an AV data selecting means 

205 for selecting necessary AV data from the AV data 
storing means 204, an AV data output controlling means 

206 for contnjiling AV data to be externally output by 
use of the AV data separated by the separating means 
202 and of the AV data selected by the AV data select- 
ing means 205, a presentation information storage 
processing means 21 1 for converting provision infonna- 
tion to presentation information in such a fomi that 
Iceeps conjunction with multiplexed AV data so as to be 
stored, a presentaUon information storing means 212 
for storing presentation information subjected to storage 
processing by the presentation information storage 
processing means 211, a presentation information 
selecting means 213 for selecting necessary presenta- 
tion information from the presentation infonnation stor- 
ing means 212 so as to instruct the AV data selecting 
means 205 to selea AV data, and a presentation infor- 



mation externally outputting means 214 for externally 
outputting presentation information selected by the 
presentation Infonnation selecting means 213. 
[0037] The broadcast transmitting apparatus 1 00 in 

5 this system multiplffltes data of an image and data of 
voice for a program, and infonnation (provision infonna- 
tion), which indicates a playback Image t o be shown 
with this image, and sends them. 
[0038] On the other hand, the broadcast receiving 

10 apparatus 200 separates the multiplexed signal trans- 
mitted, stores image and voice data, and links provision 
infonnation to multiplexed data of image and data of 
voice (i.e., converts tt to presentation infonnation), and 
stores It. 

75 [0039] When a user views the Image and voice of a 
program by use of the broadcast receiving apparatus 
200, presentation information linked to the viewed 
Image and voice is presented, and if the user selects 
any presentation information, a playback image speci- 

20 fled by the selected presentation information. 

[0040] The configuration of this system and the 
operation thereof will be more specifically explained. 
[0041] First, the configuration of the broadcast 
transmitting apparatus 100 In Fig. 1 will be specifically 

25 explained. 

(AV material storing means 101) 

[0042] The AV material storing means 1 01 is a stor- 
30 age . medium that stores AV data as material. AV data 
stored is data of Image and data of voice that makes up 
a program to be broadcast on TV In ordinary house- 
holds, and that is presented in the forms of stream, or 
encoded Ibrm such as MPEG1 , MPEG2, and the like. 
35 [0043] As storage media, there are tape media in a 
cut machine for the image, which has been used con- 
ventionally in the broadcasting stations. In addition, 
there are, for example, a memory, HDD, PD, MD, MO, 
DVD-ROM, DVD-RAIWI, DAT, D-VHS; and the like. 
to [0044] For reference sake, AV data can externally 
be added to the AV material storing means 101. 

<AV material selecting means 1 02) 

45 [0045] The AV material selecting means 102 
selects necessary AV data from the AV material storing 
means 1 01 , and sends the selected AV data to the mul- 
tiplexing means 1 03 as a broadcast signal. To select AV 
data from the AV material storing means 101, the 

50 means for externally selecting AV data is set up in the 
AV material selecting means 102 so that an Information 
provider can select AV data manually. At this time, GUI 
can be designed to facilitate the selection from the AV 
material storing means 101. 

55 [0046] In addition, the AV material selecting means 
102 also may be configured so as to include a broad- 
cast schedule therein, and to automatically select AV 
data, which matches the schedule from the AV material 
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storing means 1 01 . 

[0047] Or, there may exist other means for creating 
a broadcast schedule and managing it, and on the basis 
of the broadcast obtained therefrom, AV data may be 
automatically selected from the AV material storing 5 
means 101. 

<Provision informatfon storing means 111) 

[0048] The provision information storing means 111 w 
Is a storage medium that stores provision information to 
deal with AV data efficiently and effectively. As the stor- 
age medium, there are HDD, PD, H/ID, MO, DVD-ROM, 
DVD-RAM, and the like. In addition, DAT, D-VHS, etc., 
can be considered as tape media. ;5 
[0049] As shown in Fig. 2, provision information is 
composed of one or more elements (hereinafter 
refen-ed to as provision element), each of the elements 
having a unit expressed by a character string or a sym- 
bol string or a combination thereof, and being added 20 
thereto linking information to AV data as its attribute, 
and this provision element is systematized in the fonn of 
a single hierarchy or a multilevel hierarchy. In a case 
where the respective provision elemerrts of provision 
information are systematized in the form of a mulHIevel 25 
hierarchy, each provision element contains infomiation 
of an attribute that shows which provision element each 
provision element has relationship with and what rela- 
tionship each provision element has with such a provi- 
sion element. 30 
[0050] Thus, each provision element of provision 
information includes linking infomriation, which shows 
the entirety of the program broadcast so far or a portion 
or the entirety of the program to be broadcast or being 
on the air, as required. Then, this linking infbnnatlon can 35 
be changed with time regardless of whether or not the 
program to be linked is on the air. 
[0051] Also, as shown in Fig. 3(a), an attribute of 
ON or OFF is added to each provision element of provi- 
sion Information as information for specifying the provi- 40 
sion period. A provision element, which has been 
transmitted after adding OFF thereto, is displayed by a 
receiving side, and a provision element, which has been 
transmitted after adding ON thereto, is non-displayed by 
the receiving side. Namely, the provision element trans- 45 
mitted with provision information in an ON state is con- 
tinued to be effective as long as provision information in 
an OFF state is not transmitted. There can be consid- 
ered a form in which each proviston elements of provi- 
sion information is pre-transmitted in an OFF state and so 
stored in the receiving side, and only infomiation, which 
is changed to be in an ON state later, is transmitted. 
[0052] Further, even if the reception is started at 
any time in a period for providing information, a signal of 
provision information in an ON state may be continued 55 
to be transmitted for a certain period of time as shown in 
Fig. 4 such that proviaon infomnation of the time can be 
received. Also, there can be considered a transmission 



form wherein if a version is formed at provision informa- 
tion and the version is updated, a portion or the entirety 
of provision information concerned is newly recreated 
and transmitted even if the same provision information 
is continued to be ON. 

[0053] Also, as shown in Rg. 3(b), it is possible to 
use a form wherein period information to be provided is 
added to each provision element of provision informa- 
tion as an attribute and the display of only the period at 
the receiving side is made effective and periods other 
than the period are set to non-display. In this case, as 
shown in Fig. 5, only the time, which is expressed by the 
attribute, serves as a provision time period after provi- 
sion information is transmitted. 
[0054] Moreover, there can be consider a form in 
which infomiation having an ON/OFF signal and an 
effective period signal combined is added to each provi- 
sion element as an attribute. In addition, it is possible to 
describe time information, which denotes how long this 
infomiation has been transmitted, in provision informa- 
tion or provision elements. Since this time information is 
a correct present start time of provision information, 
effectiveness of stored presentation information or pres- 
entation elements may be detemiined on the basis of 
this present start time when a recording and playback 
are carried out by the broadcast receiving apparatus. 
[0055] Identification information for specifying the 
provision element such as a numeric string, a symbol 
string, a character string may be added to the respec- 
tive provision elements constituting provision informa- 
tion. In addition, identification infomiation may be added 
to the provision infomiation as such in order to specify 
the entirety of provision infomiation. 
[0056] Furthennore, an identifier of AV data stored 
and time infomiation of AV data (a starting time, an off- 
set time or a duration time from the starting time, a cer- 
tain time period, etc.) may be added to linking 
information to AV data to be added to the respective 
provision elements of provision information. Moreover, 
linking to character data and the like other than AV data 
is possible. It is to be noted that linking information to AV 
data Is not essential to the attributes of the respective 
provision infomiation. Moreover, a total amount of time 
required when all of the AV data have been replayed 
may be described as an attribute of each provision ele- 
ment. 

[0057] For reference sake, provision information 
may be added externally to the provision information 
storing means 111, or a provision information adding 
function that performs edition may be provided. 

(Provision InfomiaHon selecting means 112) 

[0058] The provision infomiation selecting means 
1 12 selects a portion or the entirety of the necessary 
provision InfomiaBon from the provision infomiation 
storing means 111, sends the selected provision infor- 
mation to the multiplexing means 1 03, and instructs the 
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multiplexing means 1 03 to multiplex the pravlsion infor- 
mation. 

[0059] In order to select provision Information, 
means for selecting provision information externally is 
provided, and this allows an information provider to 
select provision information (a portion or the entirety of 
provision information of Rg. 2) manually as viewing AV 
data before broadcasting, on the air, or after broadcast- 
ing. 

[0060] At this time, if the infomiation provider views 
a certain AV data and selects provision information by 
the provision information selecting means 112, the AV 
data and provision information selected simultaneously 
with the AV data is sent to the mulfiplexing means 103. 
This is the same as the case in which teiop is put on a 
screen depending on the situation in the conventional 
broadcasting, and this method makes it possible to 
transmit ON and OFF of provision information manually 
[0061] Further, as mentioned above, since provi- 
sion information may be updated with a lapse of time, 
there can be used a configuration in which the latest 
information is automatically sent to the multiplexing 
means 1 03 when provision Infomiation is once selected 
and information of linl< of the provision informaSon to AV 
data is updated. 

[0062] Moreover, provision information may be 
automatically selected in accordance with a predeter- 
mined schedule. 

[0063] In addition, there can be considered a 
method wherein a key word is extracted from the con- 
stituent elements such as an mage, a voice, etc., of the 
AV data on the air and provision infomfiation is selected 
based on information associated with the key word. 
[0064] Further, the selected provision infonnation is 
repeatedly sent to the multiplexing means 1 03 periodi- 
cally, and if the provision of provision information 
becomes unnecessary, the provision information select- 
ing means 112 instructs the multiplexing means 103 to 
stop multiplexing provision information. Namely, provi- 
sion infomnation that is ON is continuously transmitted 
at regular intervals, and if the provision of provision 
information becomes unnecessary, provision infomia- 
tion that is OFF is transmitted. 
[0065] Furthermore, there can be used a form in 
which an attribute for specifying an effective period is 
added to provision information and the resultant is sent 
to the multiplexing means 103, and the multiplexing 
means 103 performs multiplexing only for the period. 
[0066] If there is no provision infomiation to be 
selected in the provision infonnation storing means 111, 
new provision Information can be added to the provision 
information storing means 1 1 1 by use of the provision 
information adding function in the provision information 
storing means 1 1 1 , while the selection and transmission 
thereof can be carried out simultaneously 
[0067] For reference sake, the provision infonnation 
selecting means 112 does not necessarily select provi- 
sion infomiation. 



14 

{Multiplexing means 103) 

[0068] The multiplexing means 1 03 multiplexes AV 
data output from the AV data selecting means 1 02 and 

5 provision Infonnation output from the provision informa- 
flon selecting means 112, and sends the multiplexed 
signal to the transmitting means 1 04. 
[0069] The multiplexing is performed in accordance 
with MPEG2 transport stream. In addition, there is a 

10 case in which only one of AV data and provision infor- 
mation is sent to the transmitting means 104. 

(Transmitting means 104) 

15 [0070] The transmitting means 104 converts the 
multiplexed signal received to a transmission format of a 
broadcast transmission line 401 , and perfomis trans- 
mission. 

[0071] Next, the configuration of the broadcast 
20 receiving apparatus 200 of Fig. 1 will be specifically 
explained. 

(Receiving means 201) 

25 [0072] The receiving means 201 receives a broad- 
cast signal transmitted from the broadcast transmission 
line 401 , and sends the received broadcast signal to the 
separating means 202. 

30 {Separating means 202) 

[0073] The separating means 202 provides a for- 
mat conversion of the broadcast signal output from the 
receiving means 201, which is opposite to the transmit- 

X ting means 1 04 of the broadcast transmitting apparatus 
100, and performs processing thereof, which is opposite 
to the multiplexing means 103, to separate the signal 
into AV data and provision information. The separated 
AV data is sent to the AV data storage processing sec- 

40 tion 203 and AV data output controlling means 205. In 
addition, the separated provision infonnation is sent to 
the presentation infonnation storage processing means 
211. 

[0074] For reference sake, a broadcast signal is not 
45 always composed of AV data and provision information 
multiplexed, and some broadcast signals are composed 
of only AV data. In this case, processing for only AV data 
is perfomfted. 

so (AV data storage processing means 20^ 

[0075] The AV data storage processing means 203 

obtains AV data from the separating means 202. and 
stores it in the AV data storing means 204. At this time, 
55 they are managed in the form such that a portion or the 
entirety of AV data to be stored can be identified. For 
example, AV data in unit of program is managed by use 
of SI Information and EPG Information, information of 
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the program (broadcasting station identification, pro- 
gram Identification, andtfie like) and offset time from the 
program start time, and the duration time, and the lil^e 
are obtained from presentation information to be 
explained later, and a specific range of AV data is man- s 
aged. Moreover, this management may be performed 
by use of time at which the broadcast signal has been 
received or identifiers (character string, symbol string, 
numeric string) divided by the broadcast receiving 
apparatus by itself. 

[0076] i=or reference sal<e, either of AV data in a 
stream format and AV data in a file fomnat may be stored 
in the AV data storing means 204. 
[0077] In addition, all AV data received may be 
stored, the storage may be started by programming, or is 
all that the user has reviewed may be stored. 

<AV data storing means 204> 

[0078] The AV data storing means 204 is a storage so 
medium that stores AV data output from the AV data 
storage processing means 203. As the storage medium, 
there are a memory, HDD, PD, MD, MO, DVD-ROM, 
DVD-RAM, and the like. In addition, DAT, D-VHS, ete.. 
can be used as tape media. 25 

<AV data selecting means 205) 

[0079] The AV data selecting means 205 selects a 
portion or the entirety of the necessary AV data and 30 
sends the selected AV data to the AV data output con- 
trolling means 206. At this time, the AV data selecting 
means 205 performs the selection of AV data on the 
basis of infonmation for selecting AV data from the pres- 
entation information selecting means 213, or performs 35 
the selection on the basis of infonnation such as identi- 
fiers of AV data stored in the AV data storing means 204 
or time information of AV data (a starting time, an offset 
time or a duration time from the starting time, a certain 
time period, etc.). 40 
[0080] Moreover, it is possible to provide inputting 
means that can select AV data externally in the AV data 
selecting means 205 such that the user can directly 
select AV data from the AV data storing means 204. 
This is the same as the general video operation. 45 

(AV data output controlling means 206) 

[0081] The AV data output controlling means 206 
controls AV data to be externally output, that is, AV data so 
to be cun-ently broadcast by use of AV data separated 
from the separating means 202 and AV data output from 
AV data selecting means 205, to send the controlled AV 
data to the AV data externally outputting means 207. 
[0082] Here, to control AV data to be sent to the AV 55 
data externally outputting means 207, for example, AV 
data switching is performed. Namely, AV data, which 
has been Just received, and AV data stored are switched 



and output. 

[0083] For example, when AV data broadcast so far 
is received from the AV data selecting means 205, 
these AV data is output without fail. Or, when AV data 
that is input from the AV data selecting means 205 is 
output to the AV data externally outputting means 207, 
and AV data input from the AV data selecting means 
205, that has been broadcast so far, has caught up with 
AV data, which is input from the separating means 202 
and cun-ently, on the air or AV data corresponding 
thereto, at the same time. At this time, the external out- 
put is switched to AV data that is input from the separat- 
ing means 202. 

[0084] For reference sake, as a method for control- 
ling AV data to be sent to the AV data externally output- 
ting means 207, it is possible to combine two AV data 
and output it For example, AV data can be output in 
such a form that a screen on which AV data from the 
separating means 202 and AV data from the AV data 
selecting means 205 are displayed is divided into two, 
or one of two AV data Is superimposed on the other and 
displayed. 

(AV data externally outputting means 207) 

[0085] The AV data externally outputting means 
207 externally outputs AV data output from the AV data 
output controlling means 206. As an externally output- 
ting method, for example, outputting is can-led out by a 
display device for outputting an image such as TV, CRT, 
a liquid crystal display, a projector, a plasma display, 
and the like and a speaker such as a speaker. 

<Presenta1Ion InfbrmaUon storing means 212) 

[0086] The presentation information storing means 
212 is a storage medium that stores presentation infor- 
mation output from the presentation information storage 
processing means 211. As the storage Medium, there 
are a memory, HDD, PD, MD, MO, DVD-ROM, DVD- 
RAM, and the like. In addition, DAT, D-VHS, etc., maybe 
used as tape media. 

[0087] For reference sake, the presentation infor- 
mation storing means 212 may be the same media as 
that of the AV data storing means 204. 
[0088] Here, presentation information is information 
that converts the provision information to keep the rela- 
tionship with AV data multiplexed simultaneously with 
the received provision infomnation and that is managed. 
Examples of the presentation information are shown in 
Figs. 6 and 7. 

[0089] As shown in Rg. 6, in the presentation infor- 
mation, the configuration in which the respective provi- 
sion elements transmitted by provision information are 
systematized is grasped as a configuration of the pres- 
entaUon elements corresponding to the provision ele- 
ments (Rg. 6 (a)), and the presentation elements are 
managed as In a presentation element management of 
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Fig. 6 (b). In this presentation eiement management, 
tfie presentation elements are described by an element 
ID and an element name, and the node structure of the 
presentation elements are described by an upper node, 
a node relationship, and a present order at the upper 
node. Further, AV data of the target link of the presenta- 
tion elements are described as AV data linking infonna- 
tion for specifying an output AV and its time period. 
[0090] In addition, the relationship between presen- 
tation infonnation and AV data that is multiplexed into 
the presentation information is managed by describing 
a presentation ID of presentation information, identifica- 
tion information (AV to be presented) of multiplexed AV 
data and the time Information (present time period) to 
be associated with each other. 
[0091] Moreover, as shown in Fig. 7 (b), it is possi- 
ble to add the presentation AV and the present time 
period to the presentation element as its attribute so as 
to maintain the relationship with AV data every presen- 
tation element and to manage the relationship. 
[0092] Such a management is performed to output 
multiplexed provision infonnation together with the AV 
data simultaneously when AV data is ou^ut. Accord- 
ingly, a portion or the entirety of F^. 6 (a) (part of provi- 
sion infonnation of Rg. 2) of the con'esponding 
presentation information is simultaneously output In 
accordance with the output of AV data. 

{Presentation infonnation storage processing means 
211) 

[0093] The presentation Information storage 
processing 211 obtains provision information from the 
separating means 202, and converts provision informa- 
tion to a form that maintains the relationship with the 
simultaneously multiplexed AV data obtained by the AV 
data storage processing means 203, and stores it in the 
presentation information storing means 212 as presen- 
tation information, The conversion to the form that main- 
tains the relationship with AV data means to perfomi 
conversion so as to output the provision information 
multiplexed simultaneously with the AV data at the 
same time. 

[0094] Here, In order to convert provision informa- 
tion to the form that maintains the relationship with AV 
data, presentation information is managed at a broad- 
cast time period when AV data is managed at broadcast 
time (Fig. 7 (a)). Namely, since provision infonnation 
itself transmits only information, which is effective at the 
instance when it is transmitted, management Is per- 
formed such that a time period In wh'ich the presentation 
infonnation is effective is recognizable. 
[0095] For example, when a signal is received, 
which says that provision infonnation is ON at 19:00, it 
is assumed that the effective period of this provision 
information is 19:00 to 19:10 at the time of 19:10 and is 
19:00 to 19:20 at the time of 19: 20, until the same pro- 
vision information receives a signal OFF at 20:00. Thus, 



provision information can be convert:ed In the form that 
maintains the relationship with AV data by continuing to 
update the effective period of the presentation informa- 
tion. 

5 [0096] IMoreover, even in the case of management 
every presentation element as shown in Rg. 7(b), the 
updating of the effective period of the presentation ele- 
ment may be continued as the same whenever neces- 
sary. 

10 [0097] In a case where the received proviaon infor- 
mation is always presented, provision information from 
the separating means 202 is not necessarily stored in 
the presentation infonnation storing means 212 as 
presentation Infonnation converted to the fbmn that 

15 maintains the relationship with AV data simultaneously 
multiplexed. 

(Presentation information selecting means 213) 

20 [0098] The presentation Infonnation selecting 
means 213 selects a portion or the entirety of neces- 
sary presentation Infonnation from the presentation 
infonnation storing means 21 2, and sends it to the pres- 
entation information externally outputting means 214. 

25 IMoreover, the presentation information selecting means 
213 comprises externally inputting means that can 
select an artitrary presentation element from presenta- 
tion infonnation cun-ently selected. The user can select 
an aibitrary element from this externally inputting 

30 means. 

[0099] Furthennore, in a case where presentation 
infonnation is selected from the presentation infonna- 
tion storing means 212, the presentation infonnation 
and AV data are externally output in the form that main- 

35 tains the relationship in the time when they are multi- 
plexed as a multiplexed signal. For example, in a case 
where a reference time is provided and the presentation 
information selecting means 213 selects presentation 
information corresponding to a certain reference time, 

40 the AV data output controlling means 206 also selects 
AV data con'esponding to the time, whereby implement- 
ing the above. 

[0100] Moreover, the presentation Information 
selecting means 21 3 may always select the latest pres- 

45 entation information automatically Alternatively, the 
presentation information selecting means 213 may 
directly receive notification of updating of presentation 
infonnation and select presentation Infonnation based 
on this notification. 

50 [0101] Further, there is a case in which the presen- 
tation element Is selected tiy the aforementioned exter- 
nal means or the element of presentation information is 
automatically selected. If information (AV data linking 
information) for reproducing stored AV data is described 

55 in the element of the selected presentation information, 
in the above case the presentation information selecting 
means 213 instructs the AV data selecting means 205 
to select the con-esponding AV data. 
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[0102] Moreover, if the presentation Information is 
hierarchically structured, the instruction for selecting AV 
data Is provided to the AV data selecting means 205 
only after an Instruction element for reproducing AV 
data has been selected. 5 
[0103] Furthermore, the presentation information 
selecting means 213 may be provided with means for 
selecting the element automatically based on presenta- 
tion infomiation. This makes it possible to replay AV 
data in order based on linking information to AV data, by 10 
adding an attribute that is an automatic playback to 
each presentation element of presentation information. 

{Presentation infonnation externally outputBng means 
214) 15 

[0104] The presentation information externally out- 
putting means 214 Is means for externally outputting 
presentation information output from the presentation 
information selecting means 213. As an externally out- 20 
putting method, for example, outputting is carried out by 
a display device for outputting an image such as TV, 
CPU, a liquid crystal cOsplay, a projector, a plasma dis- 
play, and the like and a speaker such as a speaker, etc. 
[0105] In addition, since means for outputting AV 25 
data and means for outputting presentation information 
are separately provided. It is possible to take a form that 
AV data is output by TV and presentation infomiation is 
output by a remote control unit, whereby acquiring pres- 
entation information without obstructing AV data. 30 
[0106] For reference sake, AV data and presenta- 
tion information may be presented on the same screen. 
In the case of TV, for example, AV data is output onto 
the screen and presentation informatfon may be pre- 
sented thereon. In addition, an area where AV data is 35 
output may be reduced to present the presentation 
infonmation on a residual part. 
[0107] For reference sake, such a function may be 
mounted on the aforementioned AV data externally out- 
putting means 207, 4o 

(Specific example) 

[0108] Next, an actual operatton of the broadcast 
system in which the broadcast transmitting apparatus 45 
100 and broadcast receiving apparatus 200 are com- 
bined and the examples of services will be explained. 
[0109] Suppose a model wherein the broadcast 
transmitting apparatus 100 transmits provision infomia- 
tion as selecting It based on AV data of the program, so 
which is on the air and the broadcast receiving appara- 
tus 200 directly outputs presentation informaBon to be 
associated with AV data. 

(Example of provision infonmation) ss 

[0110] First, an example is given of dealing with 
provision infomnaaon in the broadcast transmitting 



apparatus 100. Fig. 2 shows an example of provision 
infonnation stored in the provision information storing 
means 111. This is an example of provision information 
in the broadcast of a baseball game, and the provision 
elements indicate a portion or the entirely of AV data, 
which has been broadcast so far or which is on the air. 
AV data indicated by the provision elements of this pro- 
vision information changes with the passage of time and 
the progress of the broadcast of the program. 
[0111] For example, there is a case wherein a base- 
ball game between a G team and a T team is broadcast 
live. Suppose that the G team was in the lead at the time 
of 20:00, and AV data of the G team at this time was 
used as a highlight. However, if the T team won the 
game at the time of 21 :00, there is possibility that the 
previous AV data of G team used as a highlight will 
becomes unnecessary because of the victory of the T 

[01 12] Next, as a selective range of provision infor- 
mation, "broadcast of baseball game" and all aftenvard 
can be selected as provision infomiation by the provi- 
sion infomiation selecting means 1 12, or "A player" and 
all afterward can be partially selected as provision infor- 
mation, or only "A player" and "B player* of "G team" can 
be selected as provision information. 
[0113] Moreover, in order to designate the provide 
period of provision information, ON/OFF is provided to 
each element of provision infonnation, provision infor- 
mation to be desirably displayed is transmitted with an 
attribute of ON, and provision information to be desira- 
bly non-displayed is transmitted with an attribute of OFF. 
Rg. 3(a) shows that provision elements of "at bat" of "A 
player" and "abbreviated viewing" are currently dis- 
played and the other elements are non-displayed. 
110114] In the above example, the respective provi- 
sion elements of provision information indicated a por- 
tion or the entirety of AV data, which has been 
broadcast so far or which is on the air. However, the pro- 
vision elements of provision Information may indicate a 
portion or the entirety of AV data of programs that will be 
broadcast hereafter or that are broadcast in other 
broadcasting stations. 

(Example of presentation information) 

[0115] Next, examples are given of dealing with 
presentation infonnation in the broadcast receiving 
apparatus 200. Figs. 6 and 7 show examples of presen- 
tation information stored in the presentation information 
storing means 212. This is an example of provision 
infonnation in the broadcast of a baseball game. In Rg. 
6, the provision elements indicate a portion or the 
entirety of AV data, which has been broadcast so far or 
which is now on the air. The presentation element man- 
agement shown in Fig. 6 (b) is composed of a presenta- 
tion object, which shows a presentation element ID and 
an element name, node constituent informalSon for 
showing the relationship between nodes such as an 
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name of upper node, the relationship with the element 
and a presenting order in the same hierarchy, and AV 
data linl<ing information, which shows a link between 
Information for identifying AV data and the correspond- 
ing AV data such as a time period. 
[0116] Since this is based on the assumption that 
provision Information of Fig. 2 will be received, the man- 
agement depends on the provision information. For ref- 
erence sal<e, any combination of these items 
(presentation element ID, name of element, upper node, 
and the Nice} in the presentation element management 
may be formed. 

[0117J Further, in Rg. 7(a), identification infomia- 
tion (AV to be presented) of time infomnation (presenting 
time period), which have been simultaneously multi- 
plexed, are added to the provision infomiation, and the 
management is perfonned to maintain the relationship 
between provision information and AV data, separately 
for each transmitted provision information. Presentation 
information of presentation ID = 10001 shows that AV 
data is effective at 19:02 to 19:03 among AV data of 
'broadcast of baseball game in 1999", and present data 
of presentation ID = 1 0002 shows that AV data is effec- 
tive at 1 9:53 to 1 9:54 among AV data of "cooking class'. 
[0118] Furthermore, in Fig. 7(b), identification infor- 
mation (AV to be presented) of time infonnatton (pre- 
senting time period), which have been simultaneously 
multiplexed, are added as attributes of presentation 
information, and the management is performed to main- 
tain the relationship between presentation infomnation 
and AV data, separately for each presentatton infomia- 
tion. The presentation element of "at baf shows that AV 
data Is effective at 19:02 to 19:03, 19:20 to 19:40, and 
1 9:53 to 1 9:54 among AV data of "broadcast of baseball 
game in 1 999". The relationship of nodes shows that the 
presentation element of "A player" is its parent and is to 
be presented at the first in the same hierarchy. In addi- 
tion, the presentation element of "profile" shows that AV 
data is effective at 1 9:02 to 1 9:03, 1 9:53 to 1 9:54 among 
AV data of "broadcast of baseball game in 1999". The 
relationship of node shows that the presentation ele- 
ment of "A pl^er" is its parent and is to be presented at 
the second In the same hierarchy. l\/loreover, AV data of 
'baseball yearbook" is linked at 18:35 to 18:40. 

(Operation flow) 

[01 1 9] Next, the following will explain an example of 
a flow up to transmissnn of AV data and provision infor- 
mation in the broadcast transmitting apparatus 1 00 with 
reference to Figs. 8 and 9. 

[0120] Here, step 1 1 05 of Fig. 8 is shown in Fig. 9. 
An information provider selects an AV material from the 
AV material storing means 101 by use of the AV mate- 
rial selecting means 102 at a program starting time or 
immediately before the start (step 1101). Then, if the 
program is not ended (step 11 02), processing for trans- 
mitting the selected AV material as stream data is per- 
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formed, so that AV stream data to be cun-ently 
transmitted is created (step 11 03), and the created data 
is sent to the multiplexing means 1 03 (step 1 1 04). If the 
program is ended in step 1102, end processing (step 

5 1 1 08) is carried out, and the operation is ended. 

[0121] Next, in a provision information select 
processing step 1105, the infomiation provider views 
the content of AV data, which is currently on the air, and 
selects provision infomiation relative to the content from 

10 the provision infomiation storing means 1 11 by use of 
the provision information selecting means 112 (step 
1111), and sends the selected provision information to 
the multiplexing means 103 (step 1112). Then, broad- 
casting AV data and selected provision infonnatton are 

IS multiplexed (step 1 1 06), and transmitted (step 1 1 07). In 
addition, if the information provider does not select pro- 
vision infomiation in step 1111, only stream data of AV 
material is transmitted (steps 1 1 06, 11 07). 
[0122] This makes it possible to transmit relevant 

20 provision information to AV data, which is currently on 
the air. 

[0123] The information provider performs the selec- 
tion from the stored provision infonnatton in step 1111. 
However, It Is possible to use a manner, in which provl- 

25 sion information newly created when necessary is 
selected and transmitted. In addition, it is possible Id 
use a manner in which AV data and provide data are 
linked in advance, and provision Informatton is transmit- 
ted simultaneously with AV data. 

30 [0124] The element of provision infomiation to be 
selected is linked to some of entirety of AV data broad- 
cast so far. In order to indicate linked AV data, for exam- 
ple, the starting time and reproducing time are added to 
each element, in addition, provision information may be 

35 linked to AV data to be broadcast from hereafter. 

[0125] Next, Fig. 10 shows an example of a flow in 
which the broadcast receiving apparatus 200 receives a 
broadcast signal (AV data, provision information, and 
the nke) from the broadcast transmitting apparatus 1 00, 

40 and the user selects an arbitrary element from the pro- 
vision infomnation, and replays AV data corresponding 
to the selected element Hereinafter, the explanation is 
given on the assumfrtion that all broadcasts so far would 
be stored. 

45 [0126] First, the receiving means 201 and separat- 
ing means 202 of the broadcast receiving apparatus 
200 receive a multiplexed broadcast signal (AV data, 
provision infomnation, and the like) from the broadcast 
transmitting apparatus 100, and separate the received 

50 signal to AV data and provision Information, respectively 
(step 1 201 ). Then, if there is provision infomiation in the 
received broadcast signals (step 1202), the provision 
information storage processing means 21 1 stores pres- 
entation information converted to the form that main- 

55 tains the relationship with multiplexed AV data in time 
(step 1203). If there Is no provision infomiation therein, 
the presentation information storage processing means 
21 1 is on standby until the reception of provision infor- 
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mation (step 1202). 

[0127] The presentation information selecting 
means 213 selects presentation information to be cur- 
rently presented from the presentation information stor- 
ing means 212, and the presentation information 
externally outputting means 214 presents the presenta- 
tion information (step 1204). 

[0128] Then, in a standby state until the user 
selects an arbitrary element from the presentation infor- 
mation presented, if the user selects an element (step 
1 205), the AV data selecting means 205 selects AV data 
from the AV data storing means 204 based on linking 
infonnation to AV data described n the selected element 
(step 1206), and the AV data output controlling means 
206 determines that stored AV data is replayed, and the 
AV data externally outputting means 207 replays the AV 
data (step 1207). 

[0129] Therefore, by reproducing stored AV data, 
which the informatfon provider has intentionally edited, 
as information relating to AV data, which is currently 
broadcast when the information provider wishes, the 
user of the broadcast receiving apparatus 200 can view 
AV data broadcast so far in a form that ref leots the infor- 
mation provider's intention. 

[0130] For reference sake, in step 1205, the pre- 
senting period of presentation infonnation can be con- 
trolled by ON/OFF added to the provision information. 
Namely, when received provision information is ON, dis- 
play is carried out, and when It is OFF, non-display is 
carried out. If provision information ON Is continuously 
received, presentation Information Is updated. In addi- 
tion, if ON is continuously received, the detemninatlon of 
update may be can-led out as considering the version of 
provision information. Moreover, If the presentation 
information selected by the user is updated, the old 
presentation information may be used as it is, or forcibly 
changed to new one. 

[0131] For reference sake, in step 1205, the period 
for displaying presentation information may be set to a 
certain fixed period or detenmined based on period con- 
trol by the broadcast transmitting apparatus 1 00. 
[0132] Moreover, in step 1205, the operation may 
be unconditionally moved to step 1206 without the 
user's selection to replay AV data. 
[0133] Further, in step 1205, if presentation infor- 
mation has the hierarchical structure, a step for search- 
ing presentation infonnation hierarchically This 
hierarchical processing may be performed by the pres- 
entation information selecting means 213. 
[0134] Furthemnore, in linking information to AV 
data In provision information, It Is possible to describe 
an AV data reprodudng method such that Instructs the 
order to replay AV data, or if AV data are presented on 
divided parts of the screen or are presented overlaying 
one on another. 

[0135] In addition, it is possible to configure the pro- 
vlston elements such that they indcate not only AV data 
but also data such as character Irrfonnation stored in the 
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broadcast receiving apparatus, or store data such as 
character information therein to be provided. 
[0136] Thus, the use of means for providing 
intended information when the information provider 
5 Intends makes it possible to provide the following serv- 
ices to the user. 

(Example of servk^s) 

10 [0137] It is assumed that the baseball game is 
broadcast live, and that AV data of the broadcast of the 
baseball game so far are stored since the start of the 
game. Then, it is assumed that a scene is just broadcast 
in which A player is at bat. Then, the infonnation pro- 

15 vider starts to transmit provision Information linked to 
AV data relating to the A player so far as ON. Since this 
provision information may be one that the information 
provider wishes tp provide to the user, for example, all 
scenes of A player's at bat so far can be provided by AV 

20 data and a profile such as A player' batting average can 
be provided by character information. 
[0138] Referring to Fig. 2, in the case where all 
scenes of A player's at bat are provided by AV data, pro- 
vision infbrmaflon may be given in a form of "at baf of 

25 "A player" (Fig. 1 1 ). The broadcast receiving apparatus 
200 replays scenes all scenes of A player's at bat so far 
from AV data stored so far by use of received provision 
infonnation, whereby the user can obtain service that 
information relating to A player can be seen while A 

30 player is at bat. 

[0139] In addition, the content of the service in the 
form of "at bat" of "A player" differs depending on fme 
when the user wishes to view all scenes of A plEyer's at 
bat. Namely, if 'at baf of 'A pl^r" is selected when A 

35 player is at bat the second time, only AV data of A 
player's first time at bat can be replayed since the infor- 
mation provider has transmitted only provision informa- 
tion linking to AV data of A player's first time at bat. 
IHowever, when A pl^r is at bat the third time, AV data 

40 of A player's first and second times at bat can be 
replayed since the information provider addiflonally cre- 
ates provision information linking to AV data of A 
player's second time at bat and transmits it. However, 
when A player left the batter box, the Information pro- 

45 vider do not have to provide information relating to A 
player any more. Accordingly, provision information of 
"at bat" of "A player" is transmitted as OFF, so that the 
user cannot view AV data of A player so far. 
[0140] For reference sake, in a case where the user 

so wishes to view all scenes of A player's at bat so far when 
A player is now in his second turn at bat, the user can 
view all scenes of A piker's at bat in the first and sec- 
ond turns, if provision information is linked to the broad- 
cast AV data not only in his first at bat but also in his 

55 second at bat. 

[01 41 1 Moreover, in the broadcast receiving appara- 
tus, there is a service of "abbreviated viewing*. This is 
the service in which only the noticeable scenes from the 
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stored baseball broadcast so far by the broadcast 
receiving apparatus are abbreviated and served, if 
"abbreviated viewing" element of presentation Infonna- 
tlon is selected when "abbreviated viewing" element of 
presentation information is displ^d on the screen. 
This is on the assumption that the infomriation provider 
linl<s the noticeable scenes so far to the element of 
"abbreviated viewing", and the information provider 
updates the content of the abbreviated viewing when- 
ever necessary by use of the broadcast transmitting 
apparatus. As a result, the scene a subject to be abbre- 
viated and viewed differs in accordance with the 
selected time, so that effective abbreviated viewing 
services are given to the users. 
[0142] At this time, if the information provider pro- 
vides information such as "abbreviated viewing ° service 
that the provider wishes to continue providing, the 
broadcast transmitting apparatus may transmit provi- 
sion information, serving as an attribute of provision 
infomiatlon, wherein "abbreviated viewing" is ON at a 
program starting time, and may transmit provision Infor- 
mation wherein 'abbreviated viewing" is OFF only at a 
program ending time, in addition, for adding providing 
period information to the element of provision informa- 
tion, that is, "abbreviated viewing", the period from the 
start and to the end of the program may be added 
thereto as an attribute of the element of the correspond- 
ing provision information. Namely, for a two-hour pro- 
gram, providing period infomiatlon may add an attribute 
of "effective for two hours" to the element of provision 
infomiatlon. 

[0143] For reference sake. In a case such as a 
drama that has already created as a program, the 
broadcast transmitting apparatus may set the selection 
timing of AV data and provision information, selection 
timing in advance of broadcasting the program since 
selective timing of AV data and provision information is 
determined. 

[0144] Using the above mentioned provision Infor- 
mation, the following is also possible. That is, for view- 
ing AV data stored so far and viewing AV data of other 
channels, a point of AV data, which is cun-ently viewed 

is stored. Then, the reproducing of the stored AV data is 
started from the stored point of AV data when viewing 
the same channel next time. 

[0145] As mentioned above, In this storage type 
broadcast system the information provider can provide 
the user with infomiation linl<ed to the program broad- 
cast so far, relating to AV data now on the air, which has 
been changed depending on providing lime and inten- 
tionally edited by the Information provider. In the broad- 
cast transmitting side can control the infomiatlon, which 
the Infomnatlon provider wishes to provide, linking to AV 
data, which is currently on the air. 
[0146] In addition, provision infomriation linked to 
the program broadcast so far is presented as informa- 
tion to be presented simultaneously with AV data, which 
is cun^ntly on the air, and the user arbitrarily select 
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infomriation therefrom. This allows the user to easily 
view a portion or the entirety of AV data stored. 
[0147] The user selects an element arbitrarily from 
presentation Information, which Is cun-ently presented, 

5 a portion or the entirety of AV data stored in the broad- 
cast receiving apparatus can be replayed based on link- 
ing information to AV data, which has been added to the 
element and whk;h has been intentionally edited by the 
information provider of the broadcast transmitting appa- 

10 ratus. Then, the user can effectively view the AV data 
broadcast so far or the AV data now being on the air 
reflecting the Information provider's intention. 

(Second embodiment) 

IS 

[0148] In the a broadcasting system based on stor- 
age In consumer platforms of the second embodiment, 
provision Information is transmitted from the broadcast 
transmitting apparatus to the broadcast receiving appa- 
so ratus in advance, and enabling infbnnation that makes 
the provision Infomiatlon effective is transmitted there- 
after. 

[0149] In this system, provision infonnation storing 
means 111, provision information selecting means 1 1 2, 
25 separating means 202, presentation information stor- 
age processing means 211, presentation infomiatlon 
storing means 212, and presentation Information select- 
ing means 213, which are different from those of Fig. 1 
will be explained. 

30 

(Configuration of broadcast transmitting apparatus) 
{Provision infomiatlon storing means 1 11> 

35 [0150] The respective provision elements of provi- 
sion information stored in the provision information stor- 
ing means 111 have attributes for searching the 
provision elements as well as linking information to AV 
data. For this reason. It is possible to select only a pro- 

40 vision element that has an attribute satisfying a certain 
condition. For racample, for providing the search result 
for the batting average and homer, as shown In Fig. 13, 
attributes, which denote the balling average and homer 
of eacli baseball player by a numeral value, may be 

45 added. Moreover, by adding the item of "baseball 
player" to the attributes of the provision elements such 
as 'batting average' and "profile", the provision ele- 
ments such as "batting average' or "profile" can be 
searched. The relationship between the provision ele- 

50 ments is included as an attribute. Namely, In a case 
where the provision element of "at baf is added to the 
attribute of the provision element of "A player*, a search 
for "provision element of A player and below" Is possi- 
ble. Thus, using this attribute, the user can search only 

55 forthe provision element, which the Infomiation provider 
wishes to provide to the user. 
[01 51 ] Furthermore, similar to the first embodiment, 
the provision information itself or the respective ele- 
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ments of provision information may include ON/OFF, 
which mal<es them effective or ineffective, and time 
period. 

[0152] Moreover, the provision infomnation storing 
means 111 stores controlling infomnation (hereinafter s 
referred to as enabling information, see Rg. 14) that can 
make a portion or the entirely of the necessary provi- 
sion information effective, in the aforementioned exam- 
ples of "baseball player", "at bat", and "profile", 
"baseball player" is the attribute of provision element, io 
and is also enabling information. Further, "at bat" and 
"profile" correspond to the provision elements. Further- 
more, this enabling information can be input from the 
outer section. In addition, in enabling infornration time 
information may be described, the time information indi- 75 
eating how long the information has been transmitted. 
Since this time information indicates a correct enabling 
starting time of the enabling information, enabling Infor- 
mation stored may be made effective based on this 
effective starting time when recording and reproducing 20 
are performed In the broadcast receiving apparatus. 

{Provision information selecting means 11 2> 

[0153] The provision information selecting means 25 
112 selects two kinds of provision Information. Regard- 
ing one kind of provision information, all basic provision 
information is selected from the provision information 
Storing means 111, transmitted to the multiplexing 
means 1 03, and the multiplexing means 1 03 multiplexes 30 
the provision information into AV data, which is currently 
on the air, and the transmitting means 1 04 transmits the 
resultant. Regarding the other kind, enabling informa- 
tion Is selected from the provision Information storing 
means 1 1 1 that can make necessary provision Infonna- 35 
tion ora portion or the entirety of the provision elements 
effective, and the selected enabling information is sub- 
jected to multiplexing and transmitting in the same man- 
ner as the above. 

[0154] For reference sake, enabling Infonnatlon can 40 
be input externally and be selected, as well as selected 
from the provision information storing means 111. 
[0155] Regarding the enabling infonnatlon, not only 
the provision elements of provision information but a 
script having an attribute of provision element as a con- 4S 
dition also may be used. For example, 'pitcher with 10 
or more wins" or "element of A player and below' may 
be used. 

[0156] Similar to the transmission timing of provi- 
sion infonnatlon of Fig. 4 in the first embodiment, ena- so 
bling Informaton has ON and OFF modes, if 
transmission is perfomrted in ON mode, the enabling 
information remains effective. Then if transmission is 
performed in OFF mode and the corresponding ena- 
bling infonnatlon is effective, the enabling information ss 
becomes ineffective. In addition, similar to the transmis- 
sion timing of provision Infonnatlon of Rg. 5 In the first 
embodiment, the effective time period of the enabling 



infonnation may be described in the enabling Infonna- 
tlon, and the enabling infonnatlon becomes effective at 
the receiving side only for that period. Namely, enabling 
infonnation may be transmitted In advance. 

(Configuration of broadcast receiving apparatus) 

(Separating means 202) 

[0157] The separating means 202 separates the 
broadcast signal received by the receiving means 201 
into AV data, provision Information for providing AV 
data, and enabling Infonnation for selecting a portion or 
the entirety from provision information. 

(Presentation information storage processing means 
211) 

[0158] The presentation information storage 
processing means 21 1 stores basic provision informa- 
tion to the prevent information storing means 212. Then, 
the presentation infomnation storage processing means 

21 1 sends enabling information to presentation informa- 
tion selecting means 213 when receiving the enabling 
infonnation. 

[0159] For reference sake, when enabling informa- 
tion is received, the presentation Information storage 
processing means 211 may store enabling information 
together with time information to keep the relationship In 
time with AV data multiplexed simultaneously with the 
enabling information. Thus, when the AV data is 
replayed after storing, enabling information multiplexed 
simultaneously with the AV data being replayed is sent 
to the presentation information selecting means 213, 
with reference to time infonnatlon of stored enabling 
information. 

(Presentation Informatton storing means 212) 

[0160] The presentation information storing means 

212 stores basic presentation infomnation stored In 
advance. In the case where enabling information is 
stored, the presentation Infomnation storing means 212 
stores enabling information together with AV data Iden- 
tification Infonnation (AV to be presented) and time 
infomnation (effective time period) to keep the relation- 
ship in time with AV data multiplexed simultaneously 
with the enabling infomnation (Fig. 15). Similar to the 
case in which the presentation information storage 
processing means 21 1 stores presentation information 
in the first embodiment, the effective period of enabling 
Information is stored while updating time information 
from the ON to OFF mode of enabling information. The 
respective items (enabling information ID, enabling 
infomnation, AV to be presented, and the like) of Fig. 1 5 
depend on the AV data managing form, so that they are 
for the purpose of showing the example. These items 
may be configured by any combination. 
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[0161] For reference sake, in the presentation infor- 
mation storing means 212, basic presentation infomia- 
tion may be combined with time information to be 
stored. This mal<es it possible to change basic presen- 
tation information for each broadcasting program or 5 
depending on time period, and to bring about changes 
in presentation information to be selected, since basic 
information to be searched differs from each other even 
in the same enabling information. 

[0162] IVloreover, presentation information may be 10 
created or added originally by the broadcast receiving 
apparatus 200, or may be composed of the one 
obtained from other receiving forms (Internet, CATV, 
and the like), other than being obtained from a broad- 
cast transmission line 401 . 15 

(Presentation Information selecting means 213) 

[0163] The presentation information storage 
processing means 21 1 directly sends enabling informa- 20 
tion to the presentation information selecting means 
213, whereby the presentation infonnation selecting 
means 21 3 can select effective presentation infonnation 
from the presentation infomnation storing means 212 
based on the enabling information. At this time, it is pos- 25 
sible to store enabling information to the presentation 
information storing means 212 while passing the ena- 
bling information directly to the presentation infomiation 
selecting means 213. 

[0164] For reference sake, the presentation infbr- so 
matlon selecting means 213 may extract the latest ena- 
bling information in time to the presentation infonnation 
storing means 212 from stored enabling information, 
and further select effective presentation infonnation 
from the presentation information storing means 212 35 
based on the extracted enabling information. 
[0165] Moreover, In the case where the presenta- 
tion information selecting means 213 selects presenta- 
tion Information from the presentation infonnation 
storing means 21 2 based on the enabling infonnation, a to 
general search engine and a natural language proc- 
essed search engine may be used. 

(Specific explanation) 

[0166] Next, suppose a model wherein the broad- 
cast transmitting apparatus transmits rough provision 
information in advance, enabling information for making 
a portion or the entirety of transmitted provision infonna- 
tion effective is selected based on the AV data now on so 
the air, and simultaneously transmitted, and a portion or 
the entirety is extracted from presentation infonnation 
stored based on enabling information received by the 
broadcast receiving apparatus, and is output 



{Example of provision information and that of enabling 
infonnation) 

[0167] Hara, an example of provision information 
transmitted from the broadcast transmitting apparatus is 
shown in Fig. 2 and 13, and an example of enabling 
infonnation is shown in Rg. 14. Since the respective 
elements of this provision information have an attribute 
of the information together with linking infonnation to the 
AV data broadcast so far, the respective elements of 
provision infonnation can be selected only by indicating 
the provision Infonnation Itself or pointing out the 
attribute satisfying a certain condition using enabling 
information. 

[0168] For example, if "abbreviated viewing" Is 
transmitted as enabling information by the broadcast 
transmitting apparatus, only a presentation element of 
presentation information, ttiat Is "abbreviated viewing" 
becomes effective in the broadcast receiving apparatus, 
and only one presentation element of "abbreviated 
viewing" Is extracted. Moreover, If "player having batting 
average .250 or more" is transmitted as enabling infor- 
mation, two or more presentation elements of presenta- 
tion information such as "A player" and 'B player' can 
be extracted. 

(Example of presentation information and example of 
enabling information) 

[0169] Next, the following will explain the examples 
of presentation information and enabling infonnation In 
the broadcast receiving apparatus. Presentation infor- 
mation has a form in which the attributes that can be 
searched and extracted by enabling infonnation as 
shown in Fig. 14 is added to the presentation elements 
of Rg. 6 and Fig. 7. Further, In the enabling information 
stored, Identification infomnation of AV data multiplexed 
simultaneously with the enabling information and the 
effective time period of the enabling information are 
stored in the fonn that they are described in the respec- 
tive elements (broadcasting of baseball game and the 
afterward", "abbreviated viewing", and the like) of Rg. 
14 (see Fig. 15). 

[0170] Thus, the information provider transmits pro- 
vision information in advance. Then, the information 
provider may transmit only enabling infonnation that can 
be extracted from the provision Information transmitted 
in advance. This makes It possible to facilitate the infor- 
mation provider's operation. In addition, this makes it 
possible to reduce the amount of data transmission in 
real time. There can be considered a method in which 
provision infonnation and enabling information are 
transmitted simultaneously and only the effective provi- 
sion information is extracted from the provision informa- 
tion based on the enabling information. 
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(Operation flow) 

[01 71 1 Nfflct, Rgs. 8 and 1 2 illustrate an example of 
a flow up to transmission of AV data and provision infor- 
mation in the broadcast transmitting. Here, step 1 1 05 of 5 
Fig. 8 is shown in Fig. 12. Since Fig. 8 has been already 
explained, Fig. 12 will be explained here. In Fig. 12, the 
information provider views the program, which is cur- 
rently on the air, and selects provision information, 
which is necessary for the program or AV data at this io 
time, from the provision information storing means 1 1 1 
by use of the provision infomriation selecting means 112 
(step 1121), and the selected provision infomiation is 
sent to the multiplexing means 1 03 (step 1 122). At the 
same time, the infomiation provider views the program, 15 
which is currently on the air, and selects enabling infor- 
mation, which is necessary for the program or AV data 
at this time, from the provision information storing 
means 111 by use of the provision information selecting 
means 112 (step 1123), and the selected enabling infor- 20 
mation is sent to the multiplexing means 103 (step 
1 124). Thus, two kinds of information are sent to the 
multiplexing means 103. 

[0172] Thus, the frequency of sending provision 
infomiation may be low by transmitting provision infor- ss 
mation and enabling infomnatlon separately, and an 
amount of Infomiation to be transmitted at the need for 
providing can be reduced by increasing the frequency of 
sending enabling infomtiation. For example, provision 
infomiation to be expected in the program is transmitted 30 
at only a program starting time, and enabling informa- 
tion may be transmitted in accordance with the content 
of the program thus providing only necessary pnjvision 
information. 

[0173] Next, the following will explain a different 35 
point from the first embodiment, with reference to Rg. 
10 that illustrates an example of a flow wherein the 
broadcast receiving apparatus receives the broadcast 
signal (AV data, provision information, enabling infomia- 
tion and the like), the user selects an element arbitrarily 40 
from the provision Infomiation, then reproducing AV 
data corresponding to the selected element. 
[0174] In step 1201 of Fig. 10, addingtothe separa- 
tion between AV data and provision information, separa- 
tion of enabling information is carried out. In steps 1 202, 45 
1203, determination whether or not enabling informa- 
tion is received is performed as well as determination 
whether or not provision information is received. If the 
enabling information is received, the presentation infor- 
mation storage processing means 21 1 stores enabling so 
Infomnatton in the presentation infomiation storing 
means 212 in the fomn that remains the relationship in 
time with multiplexed AV data, similar to the provision 
information. In step 1204, the presentation information 
selecting means 213 selects a portion or the entirety of 55 
presentation infomiation from the presentation infomia- 
tion of the presentation information storing means 212 
by use of enabling information multiplexed into AV data, 



wliich is cun-ently output, as a search key, and the pres- 
entation infomiation externally outputting means 214 
presents the presentation infomiation. Steps 1205, 
1206, and 1207 are the same as those of the first 
embodiment 

[01 75] Thus, in the foregoing first embodiment, the 
broadcast transmitting apparatus transmits all the infor- 
mation to be provided to the user when needed, and the 
broadcast receiving apparatus presents all the informa- 
tion received at this time. On the other hand, in the sec- 
ond embodiment, the broadcast transmitting apparatus 
transmits all provision infomiation, whteh will be neces- 
sary for the user, in advance. Then, the broadcast 
receiving apparatus stores the provision infomiation as 
presentation information. The broadcast transmitting 
apparatus selects such enabling infomiation that can be 
used for searching and extracting information to be pro- 
vided from the presentation infomiation stored in the 
broadcast receiving apparatus. Then, the broadcast 
transmitting apparatus transmits the selected informa- 
tion when the need for transmitting arises, whereby the 
broadcast receiving apparatus can present the informa- 
tion intended by the infomiation provider, when 
intended. 

[01 76] For reference sake, linking information to AV 
data. Included in each element of provision information, 
may be AV data cun^ntly on the air, or linking infonna- 
tion to AV data that will be broadcast hereafter. 

(Example of service) 

[0177] Suppose that the baseball game is being 
currently broadcast live. Suppose that the information 
provider transmits provision information shown in Figs. 
2 and 13 from the broadcast transmitting apparatus, 
upon staring the broadcast of baseball game in 
advance, and that the broadcast receiving apparatus 
stores the provision infomiation as presentation infor- 
mation. 

[0178] Then, it is assumed that a play-by-play 
announcer Is commenting on the home-run derby. 
Then, supposed that the information provider, who has 
listened to this voice, selects enabling information 
(some or entirety of Fig. 14) that is "players with 5 hom- 
ers or more" in the broadcast transmitting apparatus 
and transmits it in an ON mode. At this time, the broad- 
cast receiving apparatus receives the enabling infomia- 
tion and can extract the presentation element of only 
players with 5 or more homers using the number of 
homers of the player as a searching object from the 
stored presentatton elements. Then, only the presenta- 
tion element can be displayed in a menu fomi. The user 
selects an arbitrary presentation element from the play- 
ers with five homers or more. After that, the broadcast 
receiving apparatus replays stored AV data, which the 
infomiation provider of the broadcast transmitting appa- 
ratus has edited and whtoh relates to the player con-e- 
sponding to the presentation element, and user can 
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view the stored AV data relating to tlie selected player 
with 5 homers or more. At the instant when the com- 
mentary on the home-run derby is ended, the same 
enabling information as the previous one is sent in an 
OFF mode, so that "players with 5 homers or more" is 
non-displayed on the selection menu screen. Then, the 
Information provider transmits the entirety of previous 
provision information in an OFF mode simultaneously 
with the end of the program. 

[0179] For reference sake, in the broadcast trans- 
mitting apparatus, selecting timing of AV data, provision 
information, enabling information may be selected in 
advance of starting of the program as well as the time 
when the program Is actually broadcasting. Namely, in a 
case such as a drama that has already created as a pro- 
gram, the broadcast transmitting apparatus may set 
selecting timing of AV data and provision information In 
advance, since the selecting timing is also detennined 
already. 

[0180] Moreover, the broadcast transmitting appa- 
ratus may transmit a plurality of provision infonnation 
itself in advance, and transmit enabling infonnation for 
searching for provision Information itself later, to deter- 
mine which provision information should be made effec- 
tive later. 

[0181] As mentioned above, according to the sys- 
tem of this embodiment, provision information is trans- 
mitted in advance from the broadcast transmitting 
apparatus then enabling information for controlling pro- 
vision Information Is multiplexed Into real time AV data, 
and transmitted. This eliminates the need for generating 
Information by the broadcast transmitting apparatus, the 
information being to be provided to the user when nec- 
essary, and only enabling information as a search key 
needs to be transmitted, so that the amount of pro- 
vider's operations Is reduced. In addition, it is possible 
to reduce the amount of data, which is multiplexed into 
AV data and transmitted in real time. 

[Third embodiment) 

[01 82] In the a broadcasting system based on stor- 
age in consumer platfomis of the third embocflment, 
worl< for adding a tag to image and voice data to be 
broadcast and worl< for designating what should be 
broadcast as a reproducing image by use of the tag can 
be carried out separately. 

[0183] In the first embodiment, the link is directly 
established between provision Information and the AF 
ctata that is to be broadcast as a reproducing image. 
However, in the case of directly Ibnning a link to AV data 
from provision infonnation, work for specifying an image 
to be taken out of AV data to the playback image and 
work for designating the specified image to the provi- 
sion infonnation must be carried out simultaneously, 
thus making it difficult to carry out these works. 
[0184] The system of this embodiment specifies 
(cuts) the image to be taken out of AF data into the 
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reproducing image by using "cutting information", and 
designates provision information by use of the tags for 
this "cutting information". For this reason, cutting of AV 
data and selection of provision infonnation can be sep- 

5 arated from each other. 

[0185] In this system, provision information storing 
means 111, provision infonnalion selecting means 1 1 2, 
separating means 202, presentation information stor- 
age processing means 211, presentation information 

10 storing means 212, and presentaBon infonnation select- 
ing means 213, which are different from those of Rg. 1 
will be explained. 

{Configuration of broadcast transmitting apparatus) 

15 

(Provision Information storing means 111) 

[0186] First, the provision information storing 
means 1 1 1 stores infonnation (hereinafter referred to as 

eo cuffing infonnation) in which characteristics of the 
respective stream data of AV material is described as 
well as provision information and enabling information. 
An example of the cutting infonnation is shown in Rg. 
16(a). The cutting information is information that serves 

25 as a mark for cuffing AV data, and is described based 
on objects and phenomena such as a person and a 
landscape and an object appeared on the screen, 
music, voice, smell, and the like that people can feel. 
For example, in a case where A player, B pitcher, C 

30 catcher, D umpire are displ^d on one screen at the 
same time, AV data of this scene is composed of ele- 
ments (hereinafter referred to as cutting elements) of 
cutting information including A player, B pitcher, C 
catcher, D umpire. 

35 [0187] IVIoreover, in order to link AV data and the 
cutting element to each other, the linking is performed at 
timing when they are multiplexed. Namely, AV data and 
cutting element, which are simultaneously multiplexed, 
are linked, in addition, time infonnation how long the 

40 infonnation has been transmiffod may be described in 
the cutting informatton. Since this lime infonnation is 
correct cutting starting time of the cutting information, 
effectiveness of stored cutting information is determined 
based on this cutting starting time when the cutting 

45 infonnation is recorded and replayed by Hie broadcast 
receiving apparatus. 

[0188] For reference sake, linking to AV data may 
be described in the cutting information in advance. 

so (Provision informaQon selecting means 1 1 2) 

[0189] The. provision information selecting means 
112 has means that can select two or more arbitrary 
cutting elements simultaneously from the cutting infor- 
55 mation stored in the provision information storing 
means 111, and the information provider can select the 
cutting element arbitrarily from the cutting infonnation 
by use of this means. If the selection of the cutting ele- 
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ments is performed by the information provider, ttie pro- 
vision information selecting means 112 combines 
selected two or more cutting elements, and sends the 
resultant to the multiplexing means 103 as cutting infor- 
mation. 5 
[0190] For reference sake, cutting information 
wherein two or more cutting elements are combined as 
in Hg. 16 (c) is stored in the provision Information stor- 
ing means 1 1 1 in advance and the information provider 
may select the cutting element therefrom. io 
[0191] Moreover, instead of selecting the cutting 
information externally by the infomiation provider, it is 
possible to use the configuration wherein the provision 
infomiation selecting means 112 automatically selects 
the cutting information In response to Information of AV is 
data, which will be transmitted hereafter or is being 
transmitted, and in association with the information of 
the AV data, 

[0192] Furthermore, in a case where the cutting 
information for cutting AV data keeps the same during a 20 
fixed range of time period, the same cutting information 
is transmlffed at a fixed cycle, and infomnatlon showing 
the end of the cutting infomnatlon is transmlffed at a cut- 
ting end time. This is the same as the transmission form 
that uses the ON/OFF mode of provision Information In es 
the first embodiment. 

[0193] Moreover, the following Is also possible, that 
is, when period information showing a fixed period Is 
added to cutting information and the cutting information 
Is transmlffed, AV data is cut by the same cutting infer- so 
mation for this period. 

[0194] In addition, cutting information, which has 
already broadcast, may be transmitted simultaneously 
when cutting Information relating to the broadcast cut- 
ting Infomiation is transmitled. Namely, cutting Infomia- as 
tlon for cutting the scene of A player's first time at bat 
may be always transmitted when A player is at bat the 
second time and the third time. 

(Configuration of broadcast receiving apparatus) 40 
{Separating means 202> 

[0195] The separating means 202 separates the 
broadcast signal received by the receiving means 201 45 
into AV data, provision infomiation for providing AV 
data, and cutting information for cutting AV data. 

(Presentation information storage processing means 

211) 50 

[0196] The presentation infomiation storage 
processing means 21 1 receives provision information 
for providing AV data and cutting Information tor cutting 
AV data, which have been separated by the separating 55 
means 202, and stores them into the presentation infor- 
mation storing means 212. 

[0197] At the time of storing cutting infomiation to 



the presentation infomiation storing means 212, if AV 
data identification Infonnation such as a channel a time 
period associated with AV data, is described in the cut- 
ting information, the information Is stored thereto 
directly. Or, the cutting infomiation Is converted to infor- 
mation that can be recognized by the broadcast receiv- 
ing apparatus originally, and the converted information 
Is stored thereto. Moreover, there Is a case wherein only 
identification information such as a name is described in 
the cutting Infomiation and no information associated 
with AV data is described therein as in the case wherein 
enabling information is stored in the second embodi- 
ment. In this case, the presentation Information storing 
means 212 stores the cutting information together with 
AV data identification information (AV to be presented) 
and time Information (cutting time period) to keep the 
relationship in time with AV data multiplexed simultane- 
ously with the cutting information (see Fig. 1 7). Similarly 
to the case In which the presentation information stor- 
age processing means 21 1 stores presentation informa- 
tion In the first embodiment, the cutting period of cutting 
infomiation is stored while updating time information 
from ttie ON to OFF mode of cutting information. 
Whereby, when certain cutting information is selected, 
AV data multiplexed simultaneously with the cut infor- 
mation can be replayed. The respective items (cutting 
ID, cutting name, AV to be presented, and the like) of 
Fig. 17 depend on the AV data managing form, so that 
they are for the purpose of showing the example. These 
items may be configured by any combination. 

(Presentation information selecting means 213) 

[0198] The presentation information selecting 
means 213 selects presentation infomiation from the 
presentation information storing means 12, the presen- 
tation Information having been multiplexed simultane- 
ously with AV data currently outputting and been 
transmlffed, and the presentation information externally 
outputfing means 214 externally outputs in the menu 
form. 

[0199] Moreover, the presentation information 
selecting means 213 has means that can extemally 
select the presentation information stored in the presen- 
tation information storing means 212. Therefore, the 
user can select an arbitrary presentation element from 
the presentation Information of menu fomn, which has 
been externally output. Then, if the user selects the 
presentation element, the presentation information 
selecting means 213 extracts cutting information added 
to the presentation element or the cutting element. The 
presentation information selecting means 213 sends 
linking Infomfiation to AV data, which has been added to 
the cutting information or the cutting elements and 
which has been stored so far, toward the AV data select- 
ing means 205. This allows the AV data selecting 
means 205 to select AV data from the AV data storing 
means 204 and to output the designated AV data. 
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[0200] Thus, the broadcast receiving apparatus can 
associate presentation information and AV data with 
each other by use of cutting information as an intemie- 
diation. 

[0201] For reference sake, as a method for select- s 
ing the presentation information stored in the presenta- 
tion information storing means 212, a means can be 
configured so that the element of presentation informa- 
tion is automatically selected Instead of the external 
Input. In this case, the selection method such as a io 
selection order is described in the presentation Informa- 
tion itself, and once an element of the presentatton infor- 
mation is selected, the presentation element is 
automatically selected in order of the description 
sequentially thereafter. is 
[0202] As mentioned above, since the broadcast 
transmitting apparatus can use the cuffing infomiation 
as Uniting Infomnation to AV data, only the cutting infor- 
mation needs to be mapped to the provision infomia- 
tion, wfthout any attention to be paid to the configuration 
of the program. In addition, since the cutting of AV data 
and the provision timing of AV data are separated, the 
transmission operation can be simplified. Moreover, 
even in the broadcast receiving apparatus, the cutting 
Information intermediates between the presentation 25 
Information and AV data, so that this eliminates the 
need for connecting information of AV stream data to 
the presentation information, consequently making it 
possible to customize data easily by adding only the cut- 
ting information to the presentation information. 30 

(Example of service) 

[0203] Supposing that the broadcasting of baseball 
game is relayed live, A player's first turn at bat is already 35 
ended, and A player's second turn at bat is almost 
started. Moreover, it is assumed that Information as 
illustrated In Fig. 16 is stored in the provision informa- 
tion storing means 1 1 1 of the broadcast transmitting 
apparatus. At this time, one information provider selects w 
cutting elements such as 'broadcasting of baseball 
game", "G team", "A player", "at bat", "2", and the like 
from the cutting information, combines them, and con- 
tinues to transmit the combined cutting elements as cut- 
ting information in an ON state while the scene of A 45 
player's second turn at bat is broadcasting. Whereby, 
AV data corresponding to the scene of A player's sec- 
ond turn at bat is managed as AV data having cutting 
elements such as "broadcasting of baseball game', 'G 
team", "A player", "at bat", "2", and the like In the broad- so 
cast receiving apparatus. Moreover, another information 
provider transmits provision information relating to 'A 
player* combined with this cuffing information without 
concern for editing of AV data. Whereby, the user of 
broadcast receiving apparatus can obtain infomiation of ss 
"A player" when "A player" is "at bat". 
[0204] Namely, when A player is at bat the second 
time, the broadcast transmitting apparatus transmits 
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provision information as shown in Fig. 2 simultaneously 
with the transmission of cutting data of AV data. In the 
broadcast receiving apparatus, the user can view the 
scene of A player's at bat so far when infonrjation 
appears on the screen in the menu fonri. In addition, by 
transmitting enabling information that makes only the 
informatton of A pl^r effective, only the information of 
"A player" and aftenward Is presented, and the user can 
select only the information of "A player". For reference 
sake, when "A player" finished his turn "at bat", cutting 
information OFF is transmitted. 
[0205] Moreover, the user shoots AV data relating 
to A player voluntarily and adds cutting information of 'A 
player* to create the AV data, so that the user can select 
AV data of A pl^r shot by the user voluntarily when A 
player is at bat as heretofore. 

[0206] As mentioned above, the broadcast trans- 
mitting apparatus can carry out work for cutting AV data 
and work for selecting provision information separately, 
so that the work of infomiation provider can be shared 
and information can be provided efficiently Further- 
more, in the broadcast receiving apparatus, the user 
can easily can^ out edition agreeable to the user's tastB 
In order to clarify the relationship between the presenta- 
tion information and the cutting information. Moreover, 
in the broadcasting system, the user can obtain infor- 
mation intended by the information provider, when 
intended. 

(Fourth embodlmerit) 

[0207] In the a broadcasting system based on stor- 
age in consumer platforms of the fourth embodiment, 
the display forni of the image that is presented based on 
provision information is changed to a case of real time 
viewing in the playback viewing after storage. 
[0208] In this system, the following will explain the 
provision information storing means 1 11 of Fig. 1 , which 
is different from that of the first embodiment. 

(Provision information storing means 111} 

[0209] Provision information stored in the provision 
information storing means 1 1 1 of the broadcast trans- 
mitting apparatus has information for reproducing AV 
data broadcast so far and the attribute of the infomia- 
tion. Then, playback control after the provision infomia- 
tion is stored is described in the attribute. 
[0210] For example, . the provision information 
shoukj be displayed to keep the relationship with AV 
data broadcast at the same time in real time broadcast- 
ing ("real time" in Fig. 18). Or, although the provision 
information is associated with AV data broadcast at the 
same time in real time broadcasting, after the storage, 
such a relationship should be ignored and a different 
standard is presented, and the like. 
[0211] Regarding a different standard, there are 
examples such as that the provision Information is 
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always displayed ("ON AIR" of Fig. 18), or the provision 
information, which has been once viewed, is always dis- 
played ("VIEW" of Fig. 18), or a time period is desig- 
nated and the provision information is made effective for 
this time period ("20 to 21" of Fig. 18), or, the provision 
information is nrade effective after the storage 
("AFTER' of Rg. 1 8), and the like. 

<Example of service and that of operation) 

[021 2] Suppose that there is a program from 1 9:00 
to 21 :00 and that provision information, that is, an "inter- 
mediate result is broadcast at the time of 20:00. At this 
time, if the program is replayed after the end of this pro- 
gram, the provision information, "Intemnedlate result" 
can normally obtained at the time only after a lapse of 
one hour since the start of the program. 
[0213] Assumed that the effective period after the 
storage of the provision infonnation, that is, "entirety of 
program" or "effective from the start of program to the 
end of program after storage" ("ON AIR" of Rg. 18) is 
described in this provision infonmation. With this 
assumption, however, the presentation information of 
"immediate result' that is to be presented for the first 
time when it is 20:00 in the real time broadcasting, will 
be presented from the start to the end of the program 
when this program is replayed after the end of broad- 
casting. 

[0214] Moreover, another example will be 
explained. Suppose a case in which the user wishes to 
view the scene of A player's first turn at bat at the time 
when A player is at bat the third time. At this time, It is 
assumed that the user rewinds AV data so far and views 
the scene of A player's first turn at bat. In this case, 
there are two cases; one In which presentation ele- 
ments of A player's "second at bat" and "third at baf 
may be displayed on the screen, and the other case in 
which they may not be displayed thereon. The fornier 
case means that the presentation elements con-espond- 
ing to "second at bat" and "third at baf which have been 
already replayed and viewed one time, are displayed if 
an attribute of "provision informaflon to AV data that is 
once viewed is made effective' ("VIEW" of Fig. 18) is 
added as an attribute of the provision information. More- 
over, the latter case means that the presentation ele- 
ments con-esponding to "second at bat' and "third at 
baf are not displayed at the time when the first turn at 
bat Is replayed if an attribute of "display to keep the rela- 
tionship with AV data broadcast at the same time in the 
realtime broadcasting" ("REALTIME" of Fig. 18). 
[0215] Furthennore, there is an example wherein 
presentation information that is made effective only 
when the stored program is replayed ("AFTER" of Fig. 
18). There is a case wherein a program including com- 
mercials (GfVIs) is replayed as it was actually broadcast. 
However, when the program and commercials are 
stored and managed separately and replayed, it is pos- 
sible to change the way to replay the program after the 



storage by use of the provision information such that 
commencials are placed at random (in view of time, 
geometry, and the like) instead of reproducing the pro- 
gram as if it was actually broadcast. Namely, the follow- 

5 ing service can be conadered. More specifically, 
provision Information of "CMs are replayed at one time" 
is made effective when the playback of stored program 
is started. Then, if the user selects it, CMs to be broad- 
cast in the program are first replayed at one time, and 

10 thereafter the main part of the program is replayed. 
[0216] For reference sake, the above can be real- 
ized by transmitting enabling information that mal<es 
provision information of "CMs are replayed at one time" 
effective using enabling information of the second 

15 embodiment after the end of the con-esponding pro- 

[0217] As described above, the description of play- 
back control afterthe storage as an attribute of provision 
infomnation malces it possible to provide AV data once 
20 stored and presentation information at timing other than 
provide timing of the information provider transmitted in 
real time. Moreover, the proyam is stored, so that the 
user can freely view previous Information of the program 
by the stored presentation Information. 

25 

(Fifth embodiment) 

[0218] In the a broadcasting system based on stor- 
age in consumer platforms of the fifth errtjodiment, the 
30 range of information, which is presented with presenta- 
tion information, is limited by the user's intension and 
viewing history. 

[0219] In the system of the fifth embodiment, the 
presentation information selecting means 213 of Rg. 1, 
35 which is different from that of the first erribodiment, will 
be explained. 

(Presentation information selecting means 213) 

40 [0220] The presentation information selecting 
means 213 has means that can select the provision 
infomnation stored in the presentation information stor- 
ing means 212 externally or make it effective. Namely, 
the user can make a rule for selecting presentation 

45 infomnation or making it effective. Moreover, the config- 
uration wherein the previous rule is automatically cre- 
ated or changed based on the user's view history may 
be used. 

[0221] Here, some examples of the rule for selec- 
50 flon are given. For example, provision information 
including a key word selected from key words input by 
the user or from key words as shown In Figs. 2 and 14, 
Is presented on a higher priority basis, or inversely is, 
not presented on a higher priority basis. Or, although a 
55 rule for selection can be made such that a name of pro- 
gram, which is often viewed, Is registered as a key word, 
and only information relating thereto is presented. 
[0222] For reference sake, instead of changing the 
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rule for selection in thie presentation information select- 
ing means 213, means may be provided for editing 
presentation infomiation itself stored in the presentation 
infonTiation storing means 212, whereby presentation 
infomiation may be edited on the broadcast receiving 
apparatus side. 

[0223] IVIoreover, a rule may be provided such that 
presentation information is stored in the presentation 
information storing means 212 in the presentation infor- 
mation storage processing means 211, thus sifting 
presentation information at the storing time. 

(Example of service due to user's Input) 

[0224] Rrst, an example is given of a case in which 

the rule for selection set by the user is reflected upon 
the selection of presentation information by the presen- 
tation information selecting means 213. 
[0225] It is assumed that the baseball game is 
broadcast live. Moreover, supposed that a scene 
wherein A player is at bat is broadcast similarly to the 
foregoing embodiment. At this time, the infomiation pro- 
vider starts to provision information of A player of G 
team, S pitcher of T team, H catcher thereof, as provi- 
sion information. However, since the user has a great 
interest in team T, the user needs only the infomiation of 
S pitcher and H catcher than that of A player at this time. 
Then, the user sets a rule to give a higher priority to 
team T as a rule for selection of presentation informa- 
tion. As a result, only the presentation elements of S 
pitcher of team T and H catcher thereof are displ^ed on 
the screen even if A player of team G is at bat. Thus, 
information of T team, which is necessary for the user, 
can be obtained on a higher priority from information 
that Is provided by the information provider. 
[0226] For reference sake, the user's taste may be 
extracted from the user's inputs so far or from the view 
history, thus setting the rule for selection automatically 
such that the resultant is reflected thereon. 

(Example of service using view history) 

[0227] Next, an example is explained of a case 
wherein the view history of user is reflected on the 
selection of presentation information by the presenta- 
tion information selecting means 213. 
[0228] It is assumed that the broadcasting of the 
baseball game is broadcast live. Moreover, suppose 
that the user has not been viewing from the beginning 
and that the user did not view CM broadcast in the 
beginning. Then, the information provider transmits pro- 
vision information of "automatic playback of unviewed 
CM" just when the defensive team is changed. The 
broadcast receiving apparatus that has received this 
provision Information makes this provision information 
ineffective if there is no CM that is unviewed with refer- 
ence to the users' v'l&u history. The broadcast receiving 
apparatus makes this provision information for present- 
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ing CM effective if there is a CM that is unviewed, and 
starts to replay the CM that is unviewed automatically 
Namely, the infomiation provider can provide the serv- 
ices that can show tiie entire of the program to the user, 

5 using a vacant time in the content of the program. 
[0229] For reference sake, the above can be 
applied to the reproducing of a specific AV data when 
reproducing of the program recorded is performed after 
the end of the broadcasting of the baseball game. In 

TO other words, provision infomiation of "automatic play- 
back of unviewed CM" is sent to some scenes in 
through the program, and the provision information is 
set effective only when reproducing the program 
("AFTER" of Rg. 18). As a result, it is possible to control 

15 CM viewing based on the user's view record even while 
reproducing. 

[0230] Moreover, it is assumed that the program 
commercial of this program is broadcast before the pro- 
gram is broadcast. Then, the infomiation provider trans- 

20 mits provision infomiation of "Applying for prize if 
viewing program commercial" upon the end of the pro- 
gram. The broadcast receiving apparatus that has 
received this provision information makes the presenta- 
tion information ineffective when the program commer- 

25 cial has not been viewed, with reference to the user's 
view history. Moreover, the broadcast receiving appara- 
tus makes the presentation information effective when 
the program commercial has been viewed. As a result, 
only for persons who have viewed the program oommer- 

30 clal, presentation Infomiation will be displayed, showing 
the application method for the prize, after the end of the 
program. Further, it is possible to display the key word 
for a prize appearing in each scene, at one time, in 
association with the displaying of the application 

35 method. 

[0231] As mentioned above, provision information 
sent from the broadcast transmitting apparatus is con- 
verted to presentation information by the broadcast 
receiving apparatus, and the broadcast receiving appa- 

40 ratus can fix enabling Information that makes only the 
Ivnited presentation infomiation effective. This makes it 
possible to reflect the information provider's intension 
and to present available information for the user. More- 
over, even if presentation information is stored in the 

45 broadcast receiving apparatus, the information provider 
of the broadcast transmitting apparatus transmits ena- 
bling infomiation for extracting infomiation while is to be 
currently provided, whereby nanwing the range of 
presentation Information. Furthennore, the user of the 

50 broadcast receiving apparatus can fix enabling informa- 
tion that makes only the limited presentation information 
effective. This makes it possible to reflect the infomia- 
tion provider's intension and to present available infor- 
mation for the user. 

55 

(Sixth embodiment) 

[0232] In the a broadcasting system based on stor- 
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age in consumer platforms of the sixth embodiment, if 
information designated by provision information is not 
stored in the broadcast receiving apparatus, the broad- 
cast receiving apparatus obtains it from the database 
storing the corresponding infomnation therein, and dis- 
plays it. 

[0233] Fig. 19 shows apparatus to compose the 
broadcasting system of the sixth embodiment, namely a 
broadcast transmitting apparatus 100, a broadcast 
receiving apparatus 200, and an AV data providing 
apparatus 300 for storing all the AV data. The broadcast 
transmitting apparatus 1 00 is the same as that of Rg. 1 , 
and the broadcast receiving apparatus 200 is the same 
as the broadcast receiving apparatus of Fig. 1, but 
including an AV information transmitting means 221. 
The AV data providing apparatus 300 stores ali data 
received from the broadcast transmitting apparatus 
1 00, and when the provision of data is required from the 
broadcast receiving apparatus 200, the AV data provid- 
ing apparatus 300 transmits the corresponding data to 
the broadcast receiving apparatus 200. 
[0234] These broadcast receiving apparatus and 
AV data providing apparatus will be specifically 
explained. 

(Broadcast receiving apparatus} 

[0235] First, in the broadcast receiving apparatus of 
Fig. 1 9, the receiving means 201 , separating means 
202, AV data storage processing means 203, presenta- 
tion information storage processing means 211, AV 
data selecting means 205, which are different from 
those of the first embodiment, and the AV infomnation 
transmitting means 221, which is newly added, will be 
explained. 

(Receiving means 201) 

[0236] The receiving means 201 can receive AV 
data and presentation information through a data trans- 
mission line B 403 simultaneously through a broadcast 
transmission wave 401 . 

[0237] For reference sake, the broadcast transmis- 
sion wave 401 and data transmission line B403 may be 
one and the same transmission line. 

(Separating means 202, AV data storage processing 
means 203, presentation infomnation storage process- 
ing means 211) 

[0238] Since the receiving means 201 receives AV 
data and presentation infomnation through the transmis- 
sion lines of two routes mentioned above, data from the 
two routes are sent to the separating means 202, the AV 
data storage processing means 203, and the presenta- 
tion information storage processing means 211 simulta- 
neously. Each means processes data in the same 
manner, and data from the two routes are stored in the 
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AV data storing means 204 and in the presentation 
information storing means 212 in the same manner. 

(AV data selecting means 205) 

[0239] The AV data selecting means 205 automati- 
cally generates information (hereinafter refen^ to as 
AV information) for identifying AV data of a portion to be 
replayed when AV data, which is cun-ently to be 

10 replayed, is not presented in the AV data storing means 
204, and sends the generated information to the AV 
information transmitting means 221 . Here, any informa- 
tion may be used as AV information if it is identification 
information that can determine a portion or the entirety 

15 of the program uniquely. For example, time and date of 
broadcasting, broadcasting station, name of program, 
program start time, program end time, and the like may 
be combined with each other, and if a program can be 
specified only with a program ID, only the program ID 

20 may be used. 

[0240] AV information is automatically generated 
herein, and any trigger for generating AV information 
may be used. Therefore, generation of AV Information 
may be performed manually. 

25 

(AV information transmitting means 221) 

[0241] AV information transmitting means 221 
receives AV information from the AV data selecting 

30 means 205, and transmits it through a data transmis- 
sion line A402. For the data transmission line A402, 
Internet using a telephone line, and a fixed-line cable for 
CATV, and the like can be employed. At this time, iden- 
tification information for Identifying the broadcast receiv- 

35 ing apparatus itself may be transmitted simultaneously. 
This is used in a case wherein the transmitting side 
specifies the receiving side and transmits AV data 
thereto. Therefore, there is no need for infomnation to 
identify the receiving apparatus, in a case where a 

40 broadcasting wave employed can transmit designated 
AV data to the receiving apparatus required, even if the 
receiving side is not specified. 

(AV data providing apparatus 300) 

45 

[0242] Next, the configuration of AV data providing 
apparatus 300 of Fig. 19 will be explained. 

(Data receiving means 301) 

50 

[0243] The data receiving means 301 receives a 
broadcast signal to be broadcast to the broadcast trans- 
mission wave 401 . The broadcast signal in which AV 
data and provision infomnation are multiplexed is trans- 
55 mitted to this broadcast transmission wave 401 from the 
transmitting means 104 of the broadcast transmitting 
apparatus 100. For reference sake, there is a case In 
which only AV data is used as a broadcast signal. 
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{Data storage processing means 302) 

[0244] Data storage processing means 302 man- 
ages the broadcast signal that is received by the data 
receiving means 301 , by storing it in tine data storing 
means 303. In the case where AV data and additional 
information (provision infomnation, enabling information, 
cutting information and the like) accompanying with AV 
data are multiplexed as a broadcast signal, there are 
two storing methods; one is that they are separated 
from each other, stored and managed, and the other is 
that the broadcast signal is directly stored and managed 
as a stream. The storage management may be per- 
formed by either method. At this time, identifiers that 
can fix the data uniquely are assigned simultaneously to 
AV data and to additional information accompanying 
with AV data, then the resultarrt are stored. This makes 
it possible to extract a portion or the entirety of a certain 
specific program. 

(Data storing means 303> 

[02'K] The data storing means 303 is a storage 
medium that stores AV data and additional infonnation 
from the data storage processing means 302. A mem- 
ory. HDD, PD IVID, MO, DVD-ROM, DVD-RAM, DAT, D- 
VHS, and the like can be used as a storage medium. 

<AV information receiving means 31 1) 

[0246] An AV infomfiation receiving means 311 
receives AV infomnation that uniquely identifies AV data 
from the data transmission line A402, and sends it to the 
data selecting means 304. This AV information is one 
that is transmitted fonn the foregoing AV infonnation 
transmitting means 221, and identification infonnation 
that can specify a portion or the entirety of the program 
broadcast so far from the broadcast transmitting appa- 
ratus. 

(Data selecting means 304) 

[02471 The data selecting means 304 extracts a 
portion or the entirety of the program, which has been 
broadcast so far and stored in the data storing means 
303, based on AV information from the AV information 
receiving means 31 1 , and transmits them to the data 
transmitting means 305. Moreover, if data stored in the 
data storing means 303 is managed separately as AV 
data and additional infonnation accompanying with AV 
data, they are multiplexed and sent to the data transmit- 
ting means 305. 

(Data transmitting means 305) 

[0248] The data transmitting means 305 transmits 
data received from the data selecting means 304 to the 
broadcast receiving apparatus 200. In transmitting the 
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data, the broadcast wave used between the broadcast 
transmitting apparatus 100 and the broadcast receiving 
apparatus 200 is utilized, also Intemet using a tele- 
phone line, and a fixed-line cable for CATV, and the like 

5 can be employed. 

[0249] In the case where a data transmission line 
B403 transmits data to each receiving apparatus, for 
example, on the internet using the telephone line, it also 
receives information that can identity the receiving 

10 apparatus, which has transmitted AV information, and 
performs the transmission thereto, differently from the 
case where the data transmission line B403 transmits 
data to many receiving apparatuses as In the broadcast 
transmission wave 401. 

15 [0250] Moreover, in the case where the data trans- 
mission line B403 transmits data to many receiving 
apparatuses as in the broadcast transmission wave 
401 , the following form may be used. More specifically, 
there is provided in means for scheduling when and 

20 where the data is transmitted, and trigger information, 
which shows a transmitting schedule, is transmitted to 
the broadcast receiving apparatus, and the broadcast 
receiving apparatus that has received the trigger infor- 
mation fetches required AV data and add'rtlonal Infonna- 

25 tion accompanying with AV data again. 

(Operation flow) 

[0251] IMext, with reference to Fig. 20, the following 
30 will explain a flow wherein the AV data selecting means 
205 of the broadcast receiving apparatus generates 
necessary AV information, the AV Infonnation transmit- 
ting means 221 transmits the AV informatfen, so that the 
corresponding AV data Is received, and replayed. 
35 Herein, the following will be explained on the precondi- 
tion that AV data and provision information so far are not 
stored at all. 

[0252] First, an instruction to replay AV data is gen- 
erated (step 1 21 1 ). This instruction is directly performed 

40 by the user or It is generated based on the presentation 
infonnation. Then, the AV data selecting means 205 
searches whether or not designated AV data exists In 
the AV data storing means 204 (step 1212). if AV data 
exists, the AV data is extracted (step 1216), and 

45 replayed (step 1217). On the other hand, if no AV data 
exists, AV information for identifying designated AV data 
is created, and the AV information transmitting means 
221 transmits it (step 1213). As a result, the AV data 
providing apparatus 300 transmits the corresponding 

so AV data through the data transmission line B402 (Rg. 
21, to be explained later). Then, the AV data storage 
processing means 203 is on standby until the receiving 
means 201 receives the con-esponding AV data from 
the data transmission line B402, and if the correspond- 

55 ing AV data is received (step 1214), the AV data storage 
processing means 203 stores it to the AV data storing 
means 204 (step 1215). Then, the AV data selecting 
means 205 extracts the AV data, which is originally des- 
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ignated, (step 1216), and replayed (step 1217). 
[0253] For reference sake, the apparatus for receiv- 
ing data is not necessarily mounted on the previous 
broadcast receiving apparatus, and another data 
receiving apparatus be placed. 
[0254] Next, with reference to Rg. 21 , the following 
will explain a flow wherein the AV data providing appa- 
ratus 300 foregoing AV data transmitted by the AV infor- 
mation transmitting means 221 of the broadcast 
receiving apparatus, and transmits a portion or the 
entirety of the program broadcast so far. 
[0255] First, the AV information receiving means 
31 1 receives AV information transmitted from the broad- 
cast receiving apparatus 200 (step 1301). Then, the 
data selecting means 304 that has received the AV 
irrfonnation searches whether or not the corresponding 
AV data or provision irrtbrmation exists in the data stor- 
ing means 303 (step 1302). If no con-esponding data 
exists, the notification that no data exists is transmitted 
(steps 1 304, 1 305). If the corresponding data exists, the 
AV data and additional information accompanying with 
the AV data or either one of them is extracted from the 
data storing means 303 (step 1 303), and converted to a 
format of the data transmission line B403 and transnfiit- 
ted(step 1305). 

[0256] For reference sake, as the transmission line, 
the broadcast transmission line 401, the data transmis- 
sion line A402, and the data transmission line B403 may 
be the same as each other, or different from each other, 
or combinations of these may be the same as each 
other. 

(Example of service) 

[0257] It is assumed that the broadcasting of base- 
ball game is broadcast live. Then, supposed that the 
broadcast receiving apparatus takes a form in which the 
storage of the program starts after the user starts to 
view the program, and that the content of the broadcast- 
ing of baseball game so far is not stored at all. However, 
the AV data providing apparatus stores all of the con- 
tents of the program so far. Then, when the scene 
wherein A player is just at bat is broadcast, the informa- 
tion provider starts to transmit provision Information of A 
player linked to AV data so far in ON mode. When A 
player is at bat, the user replays the scenes of A piker's 
at bat broadcast so far based on the provision informa- 
tion received by the broadcast receiving apparatus. This 
allows the user to receive service in which the user can 
view information of A player. 

[0258] However, in this case, all the scenes of A 
player's at bat so far are not stored. Here, infbnnatlon of 
all the scenes of A player's at bat so far is transmitted to 
the AV data providing apparatus 300 as AV information. 
For example, since linking information to AV data is 
added to the presentation infomnation, the infomialion is 
transmitted directly (AV data linking infomnation of the 
presentation element configuration of Fig. 6). The AV 



data providing apparatus 300 has the storage medium 
with a large capacity where all programs broadcast so 
far are stored, and the broadcast receiving apparatus 
receives only the corresponding AV data automatically 
5 from this AV data providing apparatus. This allows the 
broadcast receiving apparatus to replay all the scenes 
of A player's at bat therefore the user can view all the 
scenes of A player's at bat so far. 
[0259] For reference sake, the AV data providing 
10 apparatus may be used as an internal configuration of 
any one of the broadcast transmitting apparatus and the 
broadcast receiving apparatus, and also be one or more 
AV data providing apparatuses provided as another 
apparatus. For example, for a plurality of broadcast 
15 transmission waves 401 including local stations, the AV 
data providing apparatus may receive and manage a 
plurality of broadcast transmission waves and AV data 
of a plurality of local stations. In addition, if there is a 
broadcast receiving apparatus having a large storage 
20 medium, the broadcast receiving apparatus possesses 
the function of the AV data providing apparatus. This 
allows the broadcast receiving apparatus having a small 
storage medium to obtain only necessary AV data from 
the broadcast receiving apparatus having a large stor- 
es age medium. 

[0260] Thus, there are cases wherein AV data to be 
replayed does not exist in the broadcast receiving appa- 
ratus, when the broadcast receiving apparatus itself has 
such a mechanism that can store the entirety of the pro- 
se gram or the storage medium is not so large. Fore these 
cases, if the AV data providing apparatus that stores the 
entirety of the program Is configured In the broadcasting 
system, the infomiation provider of the broadcast trans- 
mitting apparatus can provide the service without con- 
35 cern for the function of the broadcast receiving 
apparatus. In addition, the AV data providing apparatus 
is separated from the broadcast transmitting apparatus, 
whereby making it possible to manage AV data in vari- 
ous broadcast transmitting apparatuses and to supply 
40 the AV data to the broadcast receiving apparatus. More- 
over, the user can automatically obtain necessary data 
as required, and this allows the user to receive the serv- 
ice provided by the information provider similar to the 
broadcast receiving apparatus having the storage 
4S medium with a large capacity. 

[Effect of invention] 

[0261] As is obvious from the above explanation, 
50 according to the broadcast transmitting apparatus of the 
present invention, the information provider can provide 
the provision Information, which changes with providing 
time and is linked to AV data which has been Intention- 
ally edited by the information provider, to the user as 
55 infomiation relating to AV data, which is currently broad- 
casting. Moreover, the broadcast transmitting side can 
control information to be desirably provided in accord- 
ance with to the content of the program, which is cur- 




EP 1 047 269 A2 



50 



rently broadcasting. 

[0262] Furthermore, the broadcast receiving appa- 
ratus presents presentation information linked to AV 
data as infonnation to be presented simultaneously with 
AV data multiplexed at the same time, and the user arbi- 
trarily selects the element of the presentation Infomia- 
tion. This allows the user to view a portion or the entirety 
of stored AV data linked to the element. 
[0263] Moreover, even when the user replays the 
stored AV data, the user can catch up with the program, 
which is cun-ently broadcasting, because the AV data, 
which Is currently broadcasting, is also stored at the 
same time. 

[0264] Furthermore, the a broadcasting system 
based on storage in consumer platfomis of the present 
invention presents presentation infonnation linked to AV 
data, as information to be presented simultaneously 
with AV data multiplexed at the same time, and the user 
arbitrarily selects the element of the presentation infor- 
mation. This allows the user to view a portion or the 
entirety of stored AV data linked to the element. 
[0265] Moreover, even when the user replays the 
stored AV data, the user can catch up with the program, 
which is currently broadcasting, because the AV data, 
which Is cun-ently broadcasting, Is also stored at the 
same time. 

[0266] Namely, the user, who views the program 
from halfway, can view the program from the beginning 
efficiently, also can view the past programs effectively. 
[0267] Moreover, the user can receive the service 
wherein the broadcasting program so far is abbreviated 
and viewed based on the Intended content when the 
broadcast transmitting side intends. 
[0268] Further, in the system for transmitting ena- 
bling information from the broadcast transmitting appa- 
ratus, a portion or the entirety of the provision 
information is transmitted from the broadcast transmit- 
ting apparatus in advance. Then, at the time of providing 
information relating to the content of the program, which 
is cun^ntly broadcasting, only the enabling Information 
for searching and extracting the elements of the provi- 
sfon Information that Is made effective from the provi- 
sion information linked to AV data broadcast so far may 
be transmitted. This reduces the number of operator's 
operations for providing information. In the broadcast 
receiving apparatus, the user can obtain only the provi- 
sion information that is made effective by the informa- 
tion provider at this time, and can view a portion or the 
entirety of AV data stored so far based on the informa- 
tion. In addition, it is possible to reduce the amount of 
data, which Is multiplexed into AV data and which Is 
transmitted in real time. 

[0269] According to the system for cutting the 
broadcasting program by use of cutting information, the 
broadcast transmitting apparatus can carry outwork for 
cutting AV data and work for selecting provision infor- 
mation separately, so that the work of Information pro- 
vider can be shared and Infomnatlon can be provided 



eftksiently. Furthermore, in the broadcast receiving 
apparatus, the user can easily cany out editing agreea- 
ble to the user's taste in order to clarify the relationsh'p 
between the presentatkan information and the cutting 
5 infonnation. Moreover, in the broadcasting system, the 
user can obtain information intended by the infonnation 
provider, when intended. 

[0270] Furthermore, in the system wherein the pre- 
senting method after storing the provision Information is 

10 described as an attribute of provision information, it is 
possible to provide AV data and presentation infonna- 
tion once stored even at timing other than providing tim- 
ing by the infonnation provider as in real time. Moreover, 
the program is stored, so that the user can freely view 

15 previous information of the program by using the stored 
presentation infonnation. 

[0271] Moreover, according to the broadcast receiv- 
ing apparatus, in one that makes it possible to change 
the rule for selection of the AV data selecting means, 

20 provision infonnation sent from the broadcast transmit- 
ting apparatus Is converted to presentation information 
by the broadcast receiving apparatus, and the broad- 
cast receiving apparatus can designate enabling infor- 
mation that makes only the limited presentation 

25 Information effective. This makes it possible to reflect 
the infonnation provider's intension and to present ena- 
bling infonnation for the user. Moreover, even if presen- 
tation infonnation is stored in the broadcast receiving 
apparatus, the information provider of the broadcast 

30 transmitting apparatus side transmits enabling infonna- 
tion for extracting infonnation to be currently provided, 
whereby narowing the present range of presentation 
informatton. Furthermore, the user of the broaden 
receiving apparatus can designate enabling Infonnation 

35 that makes only the limited presentation Infonnation 
effective. This makes it possible to reflect the infonna- 
tion provider's intension and to present enabling infor- 
mation for the user. 

[0272] In the system having the AV data providing 

40 apparatus, even if there is used the broadcast receiving 
apparatus, which does not store the entirety of the pro- 
gram so far or which can not store it, AV data so far can 
be replayed without fail when It is intended to be 
replayed by use of the AV data providing apparatus, 

45 which manages a portion or the entirety of AV data and 
which transmits it as required. In addition, the AV data 
providing apparatus is separated from the broadcast 
transmitting apparatus, whereby making it possible to 
manage AV data of various broadcast transmitting 

50 apparatuses and to supply the AV data to the broadcast 
receiving apparatus. Moreover, the user can automati- 
cally obtain necessary data as required, and this allows 
the user to receive the service provided by the infonna- 
tion provider similar to the broadcast receiving appara- 

55 tus having the storage medium with a large capacity. 
[0273] The invention has been described in the 
above in connectton with preferred embodiments, and It 
will be understood that various modifications and varia- 



tions may be made without departing from the scope of 
the present invention set forth in attached claims. 

Claims 

5 

1. A laroadcasting system based on storage In con- 
sumer platfomis comprising a broadcast transmit- 
ting apparatus fortransmitting AV data including an 
image of a program and sound and a broadcast 
receiving apparatus having storing means for stor- 10 
ing received signals, wherein the broadcast trans- 
mitting apparatus multiplexes AV data and provision 
information for designating AV data, which an infor- 
mation provider intends for replay and viewing In 
accordance with the display of the AV data, and 15 
transmits it, and the broadcast receiving apparatus 
mal<es it possible to replay and view only the AV 
data designated by the provision information corre- 
sponding to the AV data when displaying the 
received AV data. 20 

2. A broadcasting system based on storage in con- 
sumer platforms according to claim 1 , wherein the 
broadcast receiving apparatus generates presenta- 
tion infonnation, which makes it possible to select 25 
the pl^back and viewing of the AV data stored to 
con-espond to the provision information, and stores 

it. 

3. A broadcasting system based on storage in con- 30 
sumer platforms according to claim 1 or 2, further 
comprising an AV data providing apparatus for stor- 
ing all AV data transmitted from the broadcast 
transmitting apparatus, wherein the broadcast 
receiving apparatus obtains the AV data from the as 
AV data providing apparatus when there is no AV 
data that a user wishes to replay and view in the 
storing means of the broadcast receiving appara- 
tus. 

40 

4. A broadcast transmitting apparatus for use In a 
broadcasting system based on storage in con- 
sumer platforms according to claim 1, 2 or 3, the 
broadcast transmitting apparatus comprising: 

45 

AV material storing means for storing AV data; 
AV material selecting means for selecting AV 
data from the AV material storing means; 
provision information storing means for storing 
the provision information; so 
provision Infomiation selecting means for 
selecting provision infomnation from the provi- 
sion information storing means; 
multiplexing means for multiplexing the AV data 
selected by the AV material selecting means 55 
and the provision information selected by the 
provision information selecting means to gen- 
erate a multiplexed signal; and 
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transmitting means for converting the multi- 
plexed signal to a broadcast signal in accord- 
ance with a transmission rule so as to transmit 
it 

5. A broadcast transmitting apparatus according to 
daim 4, wherein the provision infonnation is com- 
posed of proviaon elements systemlzed in the form 
of a hierarchical structure, and the provision infor- 
mation selecting means selects a portion or the 
entirety of the provision elements. 

6. A broadcast transmitfing apparatus according to 
darn 4 or 5, wherein the provision information is 
linked to the AV data designated by said provision 
infomiation. 

7. A broadcasting transmitting apparatus according to 
claim 6, wherein infonnation of the linked AV data is 
described in the provision element. 

8. A broadcast transmitting apparatus according to 
daim 6 or 7, wherein the linked AV data is updated 
with a lapse of time. 

9. A broadcast transmitting apparatus according to 
any one of claims 4 to 8, wherein the provision infor- 
mation enabling information for making a portion or 
the entirety of presentation Infonnation, which has 
been stored in the broadcast receiving apparatus 
and which has been linked to AV data, available. 

10. A broadcast transmitting apparatus according to 
any one of claims 4 to 9, wherein a playback and 
viewing range of the AV data, which the infonnation 
provider intends, is specified by cutting infonnation, 
and the provision information is linked to the cutting 
Information. 

11. A broadcast transmitting apparatus according to 
daim 1 0, wherein a presenting method after storing 
the presentation Information in the broadcast 
receiving apparatus is designated In the provision 
infonnation. 

12. A broadcast receiving apparatus for use in a broad- 
casting system based on storage in consumer plat- 
forms according to claim 1 , 2 or 3, the broadcast 
receiving apparatus comprising: 

receiving means for receiving a broadcast sig- 
nal; 

separating means for separating data recewed 
by the receiving means into AV data and the 
provisfon lnfonnatk3n; 

AV data storage processing means tor perfonn- 

ing storage processing of the AV data; 

AV data storing means for storing AV data sub- 
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jected to storage processing by the AV data 
storage processing means; 
AV data selecting means for selecting neces- 
sary AV data from tlie AV data storing means; 
AV data output controlling means for determin- 5 
ing AV data to be externally output by selecting 
either AV data from tiie separating means or 
AV data from tlie AV data selecting means; 
presentation information storage processing 
means for converting the provision Irtfonnation io 
separated by the separating means to the pres- 
entation information; 

presentation information storing nfieans for 
storing the presentation information; 
presentation Information selecting means for is 
selecting the presentation infomnation stored in 
the presentation infonnation storing means to 
provide an instruction of selecting AV data to 
the AV data selecting means based on the 
selected presentation information; and 20 
presentation information externally outputting 
means for externally outputting the presenta- 
tion InformaBon from the presentation infomia- 
tlon selecting means. 

25 

13. A broadcast receiving apparatus according to claim 
12, wherein AV data received in real time is sepa- 
rated by the separating means to be output to an 
external device, and the AV data is stored in the AV 
data storing means, and the presentation infomia- 30 
tlon to be externally output Is generated based on 
the provision information received In real time, and 
when any presentation infonnation is selected 
therefrom, contending data of the stored AV 



12, 13, 14 or 15, Wherein the way of selection of 
presentation information by the presentation infor- 
mation selecting means is limited based on a rule 
set by a user or an output history of AV data output 
from the AV data output controlling means. 



14. A broadcast receiving apparatus according to claim 
12 or 13, wherein when the presentation infomna- 
tion storing means stores the presentation infonna- 
tion in advance and enabling infonnation is 40 
transmitted from the broadcast transmitting appara- 
tus, the presentation Infonnation selecting means 
selects presentation infonnation, which has been 
made available by the enabling information, from 
the presentation information stored in the presenta- 45 
tion information storing means. 



1 5. A broadcast receiving apparatus according to claim 
12, 13 or 14, wherein the presentation infonnation 
storing means stores cutting infonnation that sped- so 
fles a playback and viewing range of AV data trans- 
mitted from the broadcast transmitting apparatus, 
and the presentation Infonnation selecting means 
provides the instruction of selecting AV data to the 
AV data selecting means by use of the presentation ss 
information and the cutting information. 



1 6. A broadcast receiving apparatus according to claim 
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FIG. 8 
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FIG. 9 
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FIG. 10 
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FIG. 14 
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FIG. 16 



I 6TEAM t U^Jr }ABBREWAT£DV1EWIN6 | 



lAPUYEH t }BPtAYai |CP1AYER| ( d?UYER{ 
lATBATl 



SOCCafiOALDISEST 



19eS/D6/1416aO~1&02 
1999W14 1634^1625 



m m m 



(b) 



ClflTINGNFORMATlON 




> ANDCREATECUmNGMFDRMATlOK 




REATH) Wm AV DATA PREVIOUSLY 



RBATEVflTHAVOATABY 
*^MULTIPliXINGIMIOAVDATA 
ANDlRANSMimNG 
DURING ACm BROADCAST 



m m m 



FIG. 17 



EXAMPLE OF CUTTING INFORMATION 
lomiNQINFORMftTIONID | oj 



PRESEMTATION AV CUTTlNfi TIME PERIOD 



70001 


APIAYERATBATI 


BROADCAST Ofi BASEBALL 
6AUEIN1999 


19:03-19:05 


70002 


ABBREVIATED VIEWING 


BROADCASTOFBASEBAIL 
GAME IN 1999 


19:33-19:37 



EP1 047 269 A2 



cx> 

(5 
u. 



— u 
So ^ 



iisp 





i 








s 








i 


HIGHLIGHT OF | 
LAHERHALF | 


<ATTRJBUTE> 

EFFECTIVE TIME PERIOD AFTER SI 



is 

VUJ 









1 










lEPHOD 


UTE> 










too 


51 

Vui 



EP1 047269 A2 



FIG. 19 



300 



40lBn}ADCAST 
X" TRANSMimna UKE 



100 




BftOADCASr I TmNSMITTlNQ ' 1 \r.A^ 

BBOADCASTIRANSMfSSlaJ UN£ 401 ^^nTIT 
403 

6R0A0CASr4O1 
2OOBROADCASTREC0WS ™«'5MjSS'^ 



DATA RECSVINfi [301 
MEANS r 


■ t 302 


DATAnKSViWC 
PROCESSING 
MEANS 


AVDATA 
PROVIDING 
. APPARATUS 


DATASTORING 
C MEANS ^ 
* 


303 
304 

305 ^11 


AVDATA 
SELECTING 
MEANS 


; 


AVDATA 
TBANSMnriNG 
MEANS 


AV INFORMATION 
RECEIVING 
MEANS 


. > ^, 



21 1 

ADDITIONAL 
INFOfiMATlON 
MANAGING 
MEANS 



RKSVINB 
CONTROIUNG 
MEANS 



}1 \ TRANSMISStONUNEA 
V \402MTATRWSM1! 



iSsioN ^03 ^ 
OATATRANSMISSION } 
UNEB / 



201ljfga/iNG 



PflESEffTAUON 
INFORMATION 
STORAGE 
PROCESSING MEANS 



212-r 



2131 




ADDinOKALINFORMATlON 
OlffPlffTlNS MEANS 




402 
DATA 



221 



43 



EP1 047269A2 



FIG. 20 

1211 



SPEaPYAVDATATOBE 
REPLAYED 



WHETHER 
AV DATA TO BE 
^REPIAY&P IS STORED^ 
^ 'or NOT? ^ 

NOj 1213 

GENERATE AV INFORMATION 
TODENTIFYAVDATATOBE 
REPIAYEP .. ANDTRANSMrr 



1214 



AVDATATOBE 
^EPUY^P IS RECEIVED, 
^ OR NOT? ^ 



STORE REIVED AV DATA 



EXTRACT OORRBPONDING 



1215 



r 



-,1216 



REPRODUCE CORRESPONDING 
AVDATA 



1217 



EP 1 047 269 A2 



FIG. 21 



RECEIVE AVINFOflMATlOW 



,1301 



^ WHETHER ^ 
PROGRAM (AVDATA^ 



\w IS STORED OR NOT 7 








YES] 


1303 




EXTRACT CORRESPONDING PROGRAM 
(AV DATA AND PROVISION INFORMATION) 




CREATE DATA TELiING 
THERE IS NOT CORRESPONDING 
PPOQRAM 



1304 



1305 



TRANSMnr CORRESPONDING DATa]^ 



45 



